Skip to content

Conversation

@thomasywang
Copy link
Contributor

Summary:
Create a TraceDispatcherSink that writes perfetto traces in their native protobuf format directly to local files

The advantages include:

  • No row limits (vs 400k for a scuba query)
  • Zero ingestion latency (Traces are available immediately)
  • No json -> protobuf conversion needed and very compact
  • Compatibility with distributed file systems like OILFS
  • Faster execution of expanse: No more querying scuba and conversion of scuba -> perfetto protobuf

Differential Revision: D89403329

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Dec 18, 2025
@meta-codesync
Copy link

meta-codesync bot commented Dec 18, 2025

@thomasywang has exported this pull request. If you are a Meta employee, you can view the originating Diff in D89403329.

thomasywang added a commit to thomasywang/monarch-1 that referenced this pull request Dec 18, 2025
Summary:
Pull Request resolved: meta-pytorch#2169

Create a TraceDispatcherSink that writes perfetto traces in their native protobuf format directly to local files

The advantages include:
- No row limits (vs 400k for a scuba query)
- Zero ingestion latency (Traces are available immediately)
- No json -> protobuf conversion needed and very compact
- Compatibility with distributed file systems like OILFS
- Faster execution of expanse: No more querying scuba and conversion of scuba -> perfetto protobuf

Differential Revision: D89403329
thomasywang added a commit to thomasywang/monarch-1 that referenced this pull request Dec 18, 2025
Summary:

Create a TraceDispatcherSink that writes perfetto traces in their native protobuf format directly to local files

The advantages include:
- No row limits (vs 400k for a scuba query)
- Zero ingestion latency (Traces are available immediately)
- No json -> protobuf conversion needed and very compact
- Compatibility with distributed file systems like OILFS
- Faster execution of expanse: No more querying scuba and conversion of scuba -> perfetto protobuf

Differential Revision: D89403329
@thomasywang thomasywang force-pushed the export-D89403329 branch 2 times, most recently from 5e779ae to e372e60 Compare December 22, 2025 01:08
thomasywang added a commit to thomasywang/monarch-1 that referenced this pull request Dec 22, 2025
Summary:

Create a TraceDispatcherSink that writes perfetto traces in their native protobuf format directly to local files

The advantages include:
- No row limits (vs 400k for a scuba query)
- Zero ingestion latency (Traces are available immediately)
- No json -> protobuf conversion needed and very compact
- Compatibility with distributed file systems like OILFS
- Faster execution of expanse: No more querying scuba and conversion of scuba -> perfetto protobuf

Reviewed By: moonli

Differential Revision: D89403329
Summary:

Create a TraceDispatcherSink that writes perfetto traces in their native protobuf format directly to local files

The advantages include:
- No row limits (vs 400k for a scuba query)
- Zero ingestion latency (Traces are available immediately)
- No json -> protobuf conversion needed and very compact
- Compatibility with distributed file systems like OILFS
- Faster execution of expanse: No more querying scuba and conversion of scuba -> perfetto protobuf

Reviewed By: moonli

Differential Revision: D89403329
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot. fb-exported meta-exported

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant