What's Changed

• fix: publish package install command by @RyanMarten in #555
• add max in progress (concurrent request) in online status tracker by @CharlieJCJ in #568
• fix: make process_response mandatory in create_dataset files by @kartik4949 in #574
• Cost Estimation revamp [1/n] Online processors by @CharlieJCJ in #546
• Ref/push to viewer by @kartik4949 in #576
• Ref/update/ratelimits/gemini by @kartik4949 in #578
• fix: use model name from config in cost processor by @kartik4949 in #575
• feat: extract mime_type in Image types by @kartik4949 in #582
• Feat/raft by @kartik4949 in #571
• Update README.md by @madiator in #587
• Ensure that when a list or a string is passed without a dictionary, we handle it appropriately. by @madiator in #588
• Add o3-mini models as a supported model series for structured output. by @madiator in #593
• fix: use semaphore to gate create new rows to prevent OOMs by @vutrung96 in #591
• Cleaup: Minor refactoring. by @madiator in #592
• bug: wrap estimate tokens with int in litellm backend and mime type fix. by @kartik4949 in #586
• fix: output unicode directly for gemini batch processor by @vutrung96 in #594

Full Changelog: v0.1.20...v0.1.21

What's Changed

• Update README.md to add code execution launch news by @madiator in #547
• Update README.md by @RyanMarten in #551
• Feat/resume/hosted curator viewer by @kartik4949 in #533
• ref: add gen params in testcall litellm backend by @kartik4949 in #552
• Claude 3.7 Reasoning by @RyanMarten in #536
• 0.1.20 release by @RyanMarten in #554

Full Changelog: v0.1.19.post1...v0.1.20

What's Changed

• Update badges by @RyanMarten in #501
• Update README.md to stop kluster.ai promo by @madiator in #514
• ref: summarize errors in online mode by @kartik4949 in #515
• Rich hyperlink for curator viewer by @CharlieJCJ in #516
• fix: expanduser in telemetry random id creationg by @kartik4949 in #530
• Update/litellm by @kartik4949 in #509
• Code executor enhancements + tests by @shreyaspimpalgaonkar in #495
• modify telemetry config by @shreyaspimpalgaonkar in #502
• Feat/logger by @kartik4949 in #518
• Feat/push to viewer by @kartik4949 in #520
• Fix curator tag by @RyanMarten in #539
• Minor changes to code executor by @madiator in #541
• update examples and minor fix to docker backend by @shreyaspimpalgaonkar in #540
• bump version by @shreyaspimpalgaonkar in #545
• ref: make batch response file method async by @kartik4949 in #532

Full Changelog: 0.1.19...v0.1.19.post1

What's Changed

• fix: make explicit garbage collection for rich live objects by @kartik4949 in #469
• bump 0.1.18.post4 by @vutrung96 in #465
• Update README with better poem example, more news items, and more providers. by @madiator in #476
• test: raw prompt as list of dict by @kartik4949 in #466
• feat: added generation_params per row by @richardzhuang0412 in #443
• typo by @RyanMarten in #473
• Add link to readme for gemini batch mode by @RyanMarten in #478
• logging (only log cost retrieval failure in debug) by @RyanMarten in #460
• Reasoning with OpenRouter examples by @RyanMarten in #430
• Fix/local url/file by @kartik4949 in #477
• feat: support manual cost map by @kartik4949 in #481
• Update README.md author name by @CharlieJCJ in #496
• Ref/ratelimit/togetherai by @kartik4949 in #490
• Update README.md by @RyanMarten in #497
• Fix/batch status tracker/telemetry by @kartik4949 in #499
• Feat/curator/client by @kartik4949 in #491
• fix: make request count in gemini batch processor max-requests-per-batch by @kartik4949 in #500
• Feat/batch/curator client by @kartik4949 in #503
• fix: update generic response type by @kartik4949 in #507
• Revamp CLI progress bar UI by @CharlieJCJ in #493
• docs: update litellm example by @kartik4949 in #510
• 0.1.19 bump version by @CharlieJCJ in #512
• fixing function calling example by commenting out intended error by @richardzhuang0412 in #513

New Contributors

• @richardzhuang0412 made their first contribution in #443

Full Changelog: v0.1.18.post4...0.1.19

What's Changed

• Feat/multimodal/litellm by @kartik4949 in #445
• Feat/multimodal/local urls by @kartik4949 in #454
• hotfix: fix prompt formatter by @shreyaspimpalgaonkar in #461
• update readme by @shreyaspimpalgaonkar in #462
• fix: handle empty response by @vutrung96 in #463
• add curator tag to hf_card_template by @davanstrien in #456
• add inference.net as provider by @samheutmaker in #459
• fix: Rich error log overlap by progress bar fix by @CharlieJCJ in #457

New Contributors

• @davanstrien made their first contribution in #456
• @samheutmaker made their first contribution in #459

Full Changelog: v0.1.18...v0.1.18.post4

What's Changed

• Override push_to_hub() by @shreyaspimpalgaonkar in #420
• Pass generation params in gemini batch by @kartik4949 in #418
• Kluster.ai backend by @RyanMarten in #422
• feat: add cost processor for litellm and external provider by @kartik4949 in #424
• bump: 0.1.17.post1 by @vutrung96 in #425
• docs: add news section by @kartik4949 in #426
• fix: remove args[0] in cost by @vutrung96 in #428
• fix: check model in litellm.cost instead of try catching by @vutrung96 in #429
• Verifiers for Code by @RyanMarten in #407
• Update authorship by @madiator in #431
• Fix kluster online example by @CharlieJCJ in #434
• ref: add a cost and rate limit default map json by @kartik4949 in #437
• bug: check max tokens from the generations params in output estimation by @kartik4949 in #435
• Anon telemetry by @shreyaspimpalgaonkar in #439
• Ref/general by @kartik4949 in #438
• Feat/multi modal support by @kartik4949 in #427
• ci: cache by @adamoptimizer in #411
• fix: remove kwargs so push_to_hub works on private datasets by @shreyaspimpalgaonkar in #448

Full Changelog: v0.1.17...v0.1.18

What's Changed

• Override push_to_hub() by @shreyaspimpalgaonkar in #420
• Pass generation params in gemini batch by @kartik4949 in #418
• Kluster.ai backend by @RyanMarten in #422
• feat: add cost processor for litellm and external provider by @kartik4949 in #424
• bump: 0.1.17.post1 by @vutrung96 in #425

Full Changelog: v0.1.17...v0.1.17.post1

What's Changed

• bump: 0.1.16 by @vutrung96 in #391
• Data generation example by @shreyaspimpalgaonkar in #394
• Update data generation readme by @shreyaspimpalgaonkar in #395
• Rename Bespoke-Stratos example directory by @shreyaspimpalgaonkar in #396
• docs: fix link in citation by @vutrung96 in #397
• ref: block capacity by max_tokens for anthropic online by @adamoptimizer in #387
• Update requirements.txt by @shreyaspimpalgaonkar in #402
• Update README.md by @RyanMarten in #404
• Update README.md by @RyanMarten in #405
• feat: support max parallel request processor by @adamoptimizer in #378
• ref: do not use request file info from batch metadata by @adamoptimizer in #406
• Remove upper bound from tiktoken by @kartik4949 in #409
• Feat/gemini batch processor by @adamoptimizer in #403
• bump: 0.1.17 by @vutrung96 in #417

Full Changelog: v0.1.16...v0.1.17

What's Changed

• Update README by @RyanMarten in #366
• fix: divide cost by minutes instead of num requests in rate/minute by @vutrung96 in #367
• docs: fix typo in first example by @vutrung96 in #368
• Allow lists of messages as simple input by @RyanMarten in #371
• feat: support separate rate limits for input and output tokens and add moving average estimate of output tokens by @adamoptimizer in #373
• Update CONTRIBUTING.md by @RyanMarten in #382
• Organize dependencies by @RyanMarten in #383
• feat: add support for returning the full completions object + some changes to support deepseek models by @vutrung96 in #384
• fix: check whether a model cost is available before getting cost by @vutrung96 in #385
• ref: make invalid_finish_reasons configurable by @adamoptimizer in #380
• ref: free extra capacity in online processor by @adamoptimizer in #381
• Fix/llm/dataset by @adamoptimizer in #393

Full Changelog: v0.1.15...v0.1.16

What's Changed

• Update README by @RyanMarten in #366
• fix: divide cost by minutes instead of num requests in rate/minute by @vutrung96 in #367

Full Changelog: v0.1.15...v0.1.15.post1