fix: streamed errors were previously swallowed (runpod#384)

This created false-positive completed tasks

Fixes issue runpod#373 for required input validation (runpod#379)

* fixed and added a test case for  Input validation "not working as expected runpod#373"
* added an additional unit test for None

Fix: failed requests due to race conditions in the job queue vs job p…

…rogress (runpod#376)

* fix: JobsProgress is now asyncio-safe. This prevents any race conditions when job_progress.get_job_count() was checked before getting more jobs.
* fix: strict jobs count for evaluating if new jobs can be taken `jobs_needed = concurrency - queue - in progress`
* debug: better debug logs
* improved unit tests

added parameters min_download and min_upload to create_pod (runpod#360)

debounce at HTTP 429 response (runpod#367)

fix: pings were missing requestIds since the last big refactor (runpo…

…d#362)

* Jobs-->JobsProgress to track jobs in flight + tests

* Tests for rp_ping.Heartbeat

* refactor: moved JobScaler.process_job to rp_job.handle_job

* refactor: JobScaler distinguishes JobsProgress from JobsQueue

* fix: Job should accept arbitrary properties + tests

* log and raise the JobScaler.handle_job exceptions

* refactor: graceful shutdown of tasks when worker is killed

* tests: complete tests for rp_ping

Batch Concurrency (runpod#358)

* Restored concurrency_modifier support
* Concurrent calls now use batched job takes instead of multiple parallel singular job takes
* Using asyncio.Queue to track jobs queue and processing
* JobScaler refactored to properly coordinate job takes and processing

Deprecated JobScaler.concurrency_modifier (runpod#331)

Merge pull request runpod#298 from runpod/fastai-clarity

Fastai clarity

Merge pull request runpod#296 from runpod/1.6.1-cleanup

1.6.1 cleanup