Coming soon - Get a detailed view of why an account is flagged as spam!
view details

This post has been de-listed

It is no longer included in search results and normal feeds (front page, hot posts, subreddit posts, etc). It remains visible only via the author's post history.

1
I want to teach a program to recognize websites based on their content, where should I start?
Post Body

I have already figured out already:

  • how to collect store and process data from websites at scale
  • found ways to manually validate input data

I am looking for starting points, concepts to achieve the following:

Input: object with selected data from website: text, html, image

Output: probability that website is of certain kind?

For example:

Iā€™m interested in pet store industry. I feed website data for that industry searching for keywords related to that pet stores, as a source. Then I want to process that data and as a result get probability/score that website is related to pet store industry.

Author
Account Strength
90%
Account Age
10 years
Verified Email
Yes
Verified Flair
No
Total Karma
3,065
Link Karma
1,374
Comment Karma
1,691
Profile updated: 6 days ago
Posts updated: 8 months ago

Subreddit

Post Details

We try to extract some basic information from the post title. This is not always successful or accurate, please use your best judgement and compare these values to the post title and body for confirmation.
Posted
7 years ago