Initial draft for Inference submission guide (#2378)

* Initial draft for Inference submission guide

* Update index.md

Replaced shell commands with Python for Windows compliance script com…

…patibility (#2344)

* [Automated Commit] Format Codebase

* Updated tags for submission checker command in docs

* Update mobilenets docs

* Update main.py

* Update main.py

* update dataset download commands - waymo calib (#2130)

* Merge from Master (#2155)

* Update submission_checker.py | Fix open model unit in Results (#2144)

* Add Llama 3.1 to special unit dict (#2150)

---------

Co-authored-by: Pablo Gonzalez <pablo.gonzalez@factored.ai>

* [Automated Commit] Format Codebase

* Inference docs - Update model and dataset download commands (#2153)

* Update llama2 70b model download docs

* changes in model and dataset download commands

* add powershell command to get result folder structure (#2156)

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* Fix Typo in Interactive Latencies (#2147) (#2225)

* Fix Typo in Interactive Latencies

* Update submission_checker.py

* Fix Typo in Interactive Latencies (#2147) (#2226)

* Fix Typo in Interactive Latencies

* Update submission_checker.py

---------

Co-authored-by: Miro <mirhodak@amd.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* Update MLCFlow  commands for v5.1 (#2237)

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* Update main.py

* [Automated Commit] Format Codebase

* updating for 5.1-dev (inference doc)

* [Automated Commit] Format Codebase

* fix typo

* [Automated Commit] Format Codebase

* Update main.py

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* Doc updates (#2292)

* improve submission doc

* Update index.md

* Fix for model and dataset download commands

* update submission doc

* [Automated Commit] Format Codebase

* Update index.md

* r2_downloader -> r2-downloader

* Update multithreading information about SDXL

* [Automated Commit] Format Codebase

* .lower() for consistency

* [Automated Commit] Format Codebase

* updation for llama3_1-8b edge

* [Automated Commit] Format Codebase

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Arjun Suresh <arjun@gateoverflow.com>

* Add quiet flags to MLC commands (#2309)

* Improve docs - submission generation (#2311)

* [Automated Commit] Format Codebase

* Refactor run_verification scripts to improve OS compatibility

* [Automated Commit] Format Codebase

* Refactor accuracy verification to use file reading instead of shell commands for compatibility

* [Automated Commit] Format Codebase

* Update folder structure by removing Nvidia folder

---------

Co-authored-by: github-actions <github-actions@github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Arjun Suresh <arjun@gateoverflow.com>
Co-authored-by: ANANDHU S <71482562+anandhu-eng@users.noreply.github.com>
Co-authored-by: Nathan Wasson <nathanw@mlcommons.org>
Co-authored-by: Pablo Gonzalez <pablo.gonzalez@factored.ai>
Co-authored-by: Miro <mirhodak@amd.com>

Merge branch 'master' into fix_small_llm_readme

Merge automotive reference into main branch (#2047)

* Automotive reference implementation sketch

* WIP: automotive reference implementation

* WIP add segmentation, dataset, and util functions to reference

* WIP: reference implementation with issues during post processing

* WIP update dockerfile remove pdb breaks

* WIP: reference implementation that runs samples

* Update README.md with initial docker runs

* WIP: add accuracy checker to reference

* Fix: set lidar detector to evaluation mode

* [Automated Commit] Format Codebase

* Update README.md

* Remove unnecessary mlperf conf load and implement dataset get_item_count

* add cpu only version of reference

* update dockerfile and display overal mAP

* code cleanup

* Update README.md

* fix packages versions in dockerfile

* handle frames if model predicts no objects

* Allow accuracy check on subset of datasets

* [Automated Commit] Format Codebase

* Updates automotive reference implementation (#2045)

* Remove unnecessary mlperf conf load and implement dataset get_item_count

* add cpu only version of reference

* update dockerfile and display overal mAP

* code cleanup

* Update README.md

* fix packages versions in dockerfile

* handle frames if model predicts no objects

* Allow accuracy check on subset of datasets

* [Automated Commit] Format Codebase

---------

Co-authored-by: mlcommons-bot <mlcommons-bot@users.noreply.github.com>

* [Automated Commit] Format Codebase

* fix whitespace merge errors

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* add removed code during merge

* [Automated Commit] Format Codebase

* change nms thresholds on cpu only code

---------

Co-authored-by: Pablo Gonzalez <pablo.gonzalez@factored.ai>
Co-authored-by: Arjun Suresh <arjun@gateoverflow.com>
Co-authored-by: arjunsuresh <arjunsuresh@users.noreply.github.com>
Co-authored-by: Miro <mirhodak@amd.com>
Co-authored-by: mlcommons-bot <mlcommons-bot@users.noreply.github.com>

Update format.yml to us GITHUB_TOKEN & GitHub Actions bot (#2044)

Fix delta perf check (#1804)

Fix typo in README.md

Fix code hyperlink text

Fixes #1352 (#1353)

Tuples (#1234)

* Support tuples for accelerator count

* Support ssd-large in open