Code

Batch Inferencing with TensorRT #167

Code

Open

Arfan12630 wants to merge 37 commits intomainWATonomous/wato_monorepo:mainfrom arfan/batch-inferenceWATonomous/wato_monorepo:arfan/batch-inferenceCopy head branch name to clipboard

+585-225

Commits

Commits on Nov 5, 2024

• Completed batching and creating tensrt engine

  Arfan12630

  committed
  c054c5f

  Copy full SHA for c054c5f

• Mounted file and directory

  Arfan12630

  committed
  f1f9cee

  Copy full SHA for f1f9cee

Commits on Nov 6, 2024

• Requirment txt changes

  Arfan12630

  committed
  359626b

  Copy full SHA for 359626b

• Reafactored engine build to a function

  Arfan12630

  committed
  5cb072e

  Copy full SHA for 5cb072e

• Fixed file error

  Arfan12630

  committed
  387e491

  Copy full SHA for 387e491

• Changed docker compose file

  Arfan12630

  committed
  61f48d8

  Copy full SHA for 61f48d8

• Refactored docker changes

  Arfan12630

  committed
  bea933d

  Copy full SHA for bea933d

• initialized engine

  Arfan12630

  committed
  4d4513d

  Copy full SHA for 4d4513d

Commits on Nov 8, 2024

• Built and initliazed tensorRT engine

  Arfan12630

  committed
  8074ca4

  Copy full SHA for 8074ca4

Commits on Nov 11, 2024

• Allocated memory for inferencing

  Arfan12630

  committed
  9b4637e

  Copy full SHA for 9b4637e

• fixed tensor function

  Arfan12630

  committed
  72a58a2

  Copy full SHA for 72a58a2

• Appended output tensor

  Arfan12630

  committed
  46a0d38

  Copy full SHA for 46a0d38

Commits on Nov 12, 2024

• Set up tensors, focusing on gpu allocation

  Arfan12630

  committed
  2fffe0d

  Copy full SHA for 2fffe0d

• Allocated memory

  Arfan12630

  committed
  87f0785

  Copy full SHA for 87f0785

• fixed small bug

  Arfan12630

  committed
  592a877

  Copy full SHA for 592a877

Commits on Nov 14, 2024

• Binded inp. & out., alloc. memory, setting up inf.

  Arfan12630

  committed
  ae4153c

  Copy full SHA for ae4153c

Commits on Nov 18, 2024

• Finished Inference function and allocated gpu

  Arfan12630

  committed
  2252b0e

  Copy full SHA for 2252b0e

Commits on Nov 21, 2024

• Got Bounding boxes, socres, and predicted classes

  Arfan12630

  committed
  b27effb

  Copy full SHA for b27effb

Commits on Nov 26, 2024

• Stored results, working on visualization

  Arfan12630

  committed
  485d592

  Copy full SHA for 485d592

• Refactored code

  Arfan12630

  committed
  4343435

  Copy full SHA for 4343435

• Refactored publishers

  Arfan12630

  committed
  c3551fc

  Copy full SHA for c3551fc

Commits on Nov 27, 2024

• Added eve configuration

  Arfan12630

  committed
  e1c2e47

  Copy full SHA for e1c2e47

• Eve configuiration completed for batch inf

  Arfan12630

  committed
  976ffb1

  Copy full SHA for 976ffb1

Commits on Nov 28, 2024

• Created publishers and msgs

  Arfan12630

  committed
  9624d8d

  Copy full SHA for 9624d8d

Commits on Nov 29, 2024

• Added msg file configs

  Arfan12630

  committed
  d24695a

  Copy full SHA for d24695a

Commits on Dec 3, 2024

• Refactored publishing

  Arfan12630

  committed
  b2cd80c

  Copy full SHA for b2cd80c

Commits on Dec 4, 2024

• Publishing detections on foxglove

  Arfan12630

  committed
  6de6530

  Copy full SHA for 6de6530

Commits on Dec 5, 2024

• Showing every image in foxglove topic

  Arfan12630

  committed
  a85d45f

  Copy full SHA for a85d45f

Commits on Dec 6, 2024

• Getting better accuracy for detections

  Arfan12630

  committed
  c77e53f

  Copy full SHA for c77e53f

Commits on Dec 7, 2024

• Refactored detection parsing

  Arfan12630

  committed
  e06c1aa

  Copy full SHA for e06c1aa

Commits on Dec 8, 2024

• parsing multiple tensors

  Arfan12630

  committed
  a982238

  Copy full SHA for a982238

• Refactored Mounts

  Arfan12630

  committed
  4a5cdd6

  Copy full SHA for 4a5cdd6

• Getting all detections

  Arfan12630

  committed
  5cea90f

  Copy full SHA for 5cea90f

Commits on Dec 10, 2024

• Getting all detections from all angles nuscenes

  Arfan12630

  committed
  23bde0d

  Copy full SHA for 23bde0d

Commits on Dec 12, 2024

• Batching complete, eve test remaining

  Arfan12630

  committed
  bdf39a4

  Copy full SHA for bdf39a4

Commits on Dec 17, 2024

• Refactored Changes

  Arfan12630

  committed
  a81ccba

  Copy full SHA for a81ccba

Commits on Dec 20, 2024

• Cleaned up code

  Arfan12630

  committed
  8a0a184

  Copy full SHA for 8a0a184