Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

5
Using _PARTITIONDATE pseudo column
Post Body

I may be reading the documentation incorrectly, but I am trying to test partitions on a table for real-time Reddit comments. This is the SQL I am using (Standard SQL since that is what is supported by partitioned tables)

SELECT subreddit FROM `pushshift.rt_reddit.comments` WHERE _PARTITIONDATE >= "2018-01-29"

I am getting the error:

"Error: Unrecognized name: _PARTITIONDATE at [1:60]"

Should I be using the actual field name I used as the partition (created_utc)? Will it know to only scan the partitions needed to fulfill a where request even if the times overlap days?

(i.e. _PARTITIONTIME >= "2018-01-29 09:30:00" AND _PARTITIONTIME < "2018-01-30 02:15:00"

SELECT subreddit from `pushshift.rt_reddit.comments` WHERE created_utc > TIMESTAMP(DATETIME_SUB(CURRENT_DATETIME(), INTERVAL 3 DAY))

This will show the last 3 days, so I'm assuming it would know to use just 4 partitions if the partitions are by day?

Author
Account Strength
100%
Account Age
11 years
Verified Email
No
Verified Flair
No
Total Karma
143,730
Link Karma
34,810
Comment Karma
108,242
Profile updated: 1 day ago
Posts updated: 9 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
6 years ago