Skip to content

Conversation

@jacobthebanana
Copy link
Collaborator

PR Type

Feature

Short Description

Add async fan-out reference implementation for handling second-order tasks efficiently at scale.

Example task: identify conflicts between information presented across 50 document chunks.

Tests Added

Test manually:

uv run --env-file .env src/2_frameworks/2_multi_agent/fan_out.py \
--source_dataset laliyepeng/test-cra-dataset \
--num_rows 10 \
--output_report report.md

Example output: (gist URL)

@jacobthebanana
Copy link
Collaborator Author

jacobthebanana commented Nov 23, 2025

Ready for review. As expected, this setup can consume a lot of tokens. The example below shows an attempt to identify conflicts between 50 CRA document chunks, producing this massive markdown report.

LangFuse traces:

image

@jacobthebanana jacobthebanana merged commit 88569d3 into main Nov 25, 2025
4 checks passed
@jacobthebanana jacobthebanana deleted the jjt/fan-out branch November 25, 2025 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants