This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
1
DataFusion queries
Post Body
Came across DataFusion as a composable query engine.I am planning to use it to query data from multiple sources via SQL:
- in memory arrow buffer
- parquet(s)
The data could be duplicated across sources, so I also want to give preference to data sources in case of collision.
- How could I do it in DataFusion itself?
- Does DataFusion maintain some kind of buffer pool like relational engines?
Author
Account Strength
50%
Account Age
2 years
Verified Email
Yes
Verified Flair
No
Total Karma
213
Link Karma
197
Comment Karma
16
Profile updated: 3 days ago
Posts updated: 3 months ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 11 months ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/databasedev...