Commits

Commit history

1. Commits on Dec 9, 2025

   • fix: Enable detection of unresponsive or crashed Python backend stub process (#423)

     pskiran1

     authored
     395a780View commit details

     Copy full SHA for 395a780

     Browse repository at this point
2. Commits on Dec 8, 2025

   • docs: update README with the correct Python version (#415)

     Show description for 4b15926
     nicholas-happyverse

     authored
     4b15926View commit details

     Copy full SHA for 4b15926

     Browse repository at this point
3. Commits on Nov 12, 2025

   • fix: Fix SEGFAULT in BLS Model Loading (#420)

     Show description for cbb42dd
     whoisj

     authored
     cbb42ddView commit details

     Copy full SHA for cbb42dd

     Browse repository at this point
4. Commits on Nov 6, 2025

   • build(dependencies): Update and validate boost version (#419)

     Show description for 4dae720
     mc-nv

     authored
     4dae720View commit details

     Copy full SHA for 4dae720

     Browse repository at this point
5. Commits on Nov 4, 2025

   • fix(pre-commit): update hooks versions (#418)

     mc-nv

     authored
     0f65dd6View commit details

     Copy full SHA for 0f65dd6

     Browse repository at this point
6. Commits on Oct 8, 2025

   • perf: optimize string tensor deserialization with high performance c++ implementation (#416)

     Show description for 389c770
     

     Wei Chen

     and

     wweic

     authored
     389c770View commit details

     Copy full SHA for 389c770

     Browse repository at this point
7. Commits on Aug 13, 2025

   • fix: Add input validation to model load (#404)

     Show description for 8b5a055
     mattwittwer

     authored
     8b5a055View commit details

     Copy full SHA for 8b5a055

     Browse repository at this point
8. Commits on Aug 7, 2025

   • fix: Improve error handling for Python backend model initialization failures (#408)

     pskiran1

     authored
     8f2df55View commit details

     Copy full SHA for 8f2df55

     Browse repository at this point
9. Commits on Jul 15, 2025

   • build: TPRD-1622 - Update version to CMake 4.0 or 3.31 ( 3.31.8 ) which has support for CUDA new layout (#407)

     mc-nv

     authored
     1ab97b7View commit details

     Copy full SHA for 1ab97b7

     Browse repository at this point
10. Commits on Jul 7, 2025

    • fix: Verify MemoryShm::byte_size within CPU shm boundary (#406)

      yinggeh

      authored
      7d1333eView commit details

      Copy full SHA for 7d1333e

      Browse repository at this point

    • fix: Boundary check for MessageQueueShm head index (#405)

      yinggeh

      authored
      8cfdffeView commit details

      Copy full SHA for 8cfdffe

      Browse repository at this point
11. Commits on Jun 30, 2025

    • fix: Remove shared memory key from the error response (#403)

      yinggeh

      authored
      87f6f2aView commit details

      Copy full SHA for 87f6f2a

      Browse repository at this point
12. Commits on May 7, 2025

    • refactor: Use safer backend APIs (#400)

      yinggeh

      authored
      bb82100View commit details

      Copy full SHA for bb82100

      Browse repository at this point
13. Commits on Apr 8, 2025

    • feat: add BLS decoupled response iterator's cancel() method for the request cancellation (#398)

      Show description for 7f21b67
      richardhuo-nv

      authored
      7f21b67View commit details

      Copy full SHA for 7f21b67

      Browse repository at this point
14. Commits on Feb 20, 2025

    • Add support for an optional parameter in the example repeat int32 model (#396)

      pskiran1

      authored
      1b797d6View commit details

      Copy full SHA for 1b797d6

      Browse repository at this point
15. Commits on Feb 6, 2025

    • feat: Extend response parameters support to BLS in python backend (#395)

      ziqifan617

      authored
      f61d423View commit details

      Copy full SHA for f61d423

      Browse repository at this point
16. Commits on Jan 25, 2025

    • feat: Add parameters support to InferResponse (#394)

      Show description for 1ea48a6
      kthui

      authored
      1ea48a6View commit details

      Copy full SHA for 1ea48a6

      Browse repository at this point
17. Commits on Dec 11, 2024

    • fix: Fix requested output deleting extra outputs (#390)

      Show description for b771f4f
      kthui

      authored
      b771f4fView commit details

      Copy full SHA for b771f4f

      Browse repository at this point
18. Commits on Dec 10, 2024

    • Remove Strict Requirement (#389)

      fpetrini15

      authored
      8e12347View commit details

      Copy full SHA for 8e12347

      Browse repository at this point
19. Commits on Nov 26, 2024

    • Build Updates for Ubuntu24.04 (#386) (#387) (#388)

      Show description for f3068c0
      

      mc-nv

      and

      nv-anants

      authored
      f3068c0View commit details

      Copy full SHA for f3068c0

      Browse repository at this point
20. Commits on Nov 1, 2024

    • updating pybind11 version (#384)

      KrishnanPrash

      authored
      09c3537View commit details

      Copy full SHA for 09c3537

      Browse repository at this point
21. Commits on Oct 31, 2024

    • build: RHEL8 Python Backend (#385)

      Show description for 682db01
      fpetrini15

      authored
      682db01View commit details

      Copy full SHA for 682db01

      Browse repository at this point
22. Commits on Oct 8, 2024

    • Add back 24.05 response sending path to fix performance (#381)

      Show description for a2564ea
      

      krishung5

      and

      Tabrizian

      authored
      a2564eaView commit details

      Copy full SHA for a2564ea

      Browse repository at this point
23. Commits on Sep 21, 2024

    • perf: vLLM metrics optimization (#379)

      yinggeh

      authored
      35a1c1fView commit details

      Copy full SHA for 35a1c1f

      Browse repository at this point
24. Commits on Aug 28, 2024

    • Improve the documentation for custom Python backend stubs (#377)

      Show description for d84bb57
      Tabrizian

      authored
      d84bb57View commit details

      Copy full SHA for d84bb57

      Browse repository at this point
25. Commits on Aug 16, 2024

    • feat: Add new histogram metric type (#374)

      yinggeh

      authored
      958c8c9View commit details

      Copy full SHA for 958c8c9

      Browse repository at this point
26. Commits on Aug 7, 2024

    • Release GIL during cancellation check (#372)

      kthui

      authored
      1393d6eView commit details

      Copy full SHA for 1393d6e

      Browse repository at this point
27. Commits on Aug 6, 2024

    • Delete response factory after sending complete final (#373)

      kthui

      authored
      2203a5bView commit details

      Copy full SHA for 2203a5b

      Browse repository at this point
28. Commits on Jul 31, 2024

    • refactor: Refactor string input checks (#370)

      Show description for 4d469a9
      yinggeh

      authored
      4d469a9View commit details

      Copy full SHA for 4d469a9

      Browse repository at this point
29. Commits on Jul 30, 2024

    • feat: Add BF16 tensor support via dlpack (#371)

      rmccorm4

      authored
      2b12abeView commit details

      Copy full SHA for 2b12abe

      Browse repository at this point
30. Commits on Jun 15, 2024

    • Add windows typedef for ssize_t (#368)

      rmccorm4

      authored
      c8b188fView commit details

      Copy full SHA for c8b188f

      Browse repository at this point
31. Commits on Jun 12, 2024

    • fix: Models should filter outputs based on requested outputs (#366)

      Show description for bfabfdb
      kthui

      authored
      bfabfdbView commit details

      Copy full SHA for bfabfdb

      Browse repository at this point
32. Commits on Jun 7, 2024

    • fix: [precaution fix] Capture Python futures while running in the background (#365)

      Show description for ebc8c6c
      kthui

      authored
      ebc8c6cView commit details

      Copy full SHA for ebc8c6c

      Browse repository at this point
33. Commits on Jun 6, 2024

    • Add support for response sender in the default mode (#364)

      Show description for 27f04d1
      kthui

      authored
      27f04d1View commit details

      Copy full SHA for 27f04d1

      Browse repository at this point
34. Commits on May 9, 2024

    • Add error handling in case of AutocompleteStub Failure for DLIS-5819 (#356)

      Show description for 9d2c513
      indrajit96

      authored
      9d2c513View commit details

      Copy full SHA for 9d2c513

      Browse repository at this point