This post has been de-listed
It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.
I may be reading the documentation incorrectly, but I am trying to test partitions on a table for real-time Reddit comments. This is the SQL I am using (Standard SQL since that is what is supported by partitioned tables)
SELECT subreddit FROM `pushshift.rt_reddit.comments` WHERE _PARTITIONDATE >= "2018-01-29"
I am getting the error:
"Error: Unrecognized name: _PARTITIONDATE at [1:60]"
Should I be using the actual field name I used as the partition (created_utc)? Will it know to only scan the partitions needed to fulfill a where request even if the times overlap days?
(i.e. _PARTITIONTIME >= "2018-01-29 09:30:00" AND _PARTITIONTIME < "2018-01-30 02:15:00"
SELECT subreddit from `pushshift.rt_reddit.comments` WHERE created_utc > TIMESTAMP(DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 3 DAY))
This will show the last 3 days, so I'm assuming it would know to use just 4 partitions if the partitions are by day?
Subreddit
Post Details
- Posted
- 6 years ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/bigquery/co...