Did this feature help or harm Show HN submissions as a whole?

Over the past few years, the average number of Show HN submissions per day has steadily risen. (this is strongly correlated with the growth of Hacker News as a whole)

More on that spike at the end later.

On Hacker News, users can upvote link submissions, which increases the point score of the submission; this point score is used as a rough proxy of link quality. The average amount of points per submission peaked in 2012, and has trended downward since then.

Here’s a chart of the points of Show HN submissions averaged by date of submission, then averaged across the previous 30-days to further smooth the variation and make the trend more apparent:

Users can also comment on these Show HN posts. The average amount of comments has trended downward over time, albeit only slightly.

The combination of increased Show HN submissions and a decrease in point quality over time may imply that Show HN submissions have a low signal-to-noise ratio, i.e. a low amount of good submissions relative high amount of bad submissions.

Hitting the front page of Hacker News is the first step to virality. When users upvote submissions on Hacker News, those submissions can hit the front page after achieving enough points (combined with other factors, such as submission age and quantity of other submissions). At the least, if a submission has 10 points, it has most likely hit the front page sometime in its lifespan.

What proportion of the Show HN submissions hit the front page?

Over time, the amount of good Show HNs relative to the amount of bad Show HNs has been steadily decreasing.

Has the new Show HN feature helped improve the signal-to-noise ratio?

Show and Tell HN

We can look at the immediate impact of the new Show HN section by comparing the behavior of submissions before and after the announcement. The red area in the following charts represents the daily behavior in the couple months before the release (with the red horizontal dotted line representing the statistical average for the corresponding measurement), and the blue area/blue line represents the behavior after the release.

When the Show HN feature was first announced, everyone rushed to make a submission to test it out, and it showed. In fact, the number of submissions for every day after the feature was added was greater than the average number of submissions from before the addition.

Average number of daily submissions before Show HN section is 19.13 submissions/day, average after is 53.44 submissions/day.

Average submission points and average submission comments (both aggregated by date of submission for smoothing) received a slight boost too.

Average number of daily points before Show HN section is 11.40 points/submission/day, average after is 12.12 points/submission/day.

Average number of daily comments before Show HN section is 6.57 comments/submission/day, average after is 7.16 comments/submission/day.

The percentage of Show HN submissions that hit the front page, however, moves in a different direction.

Average daily % of Show HN submissions which hit the front page before Show HN section is 19.33%, average after is 16.37%.

While the Show HN section gives more focus to Show HN submissions, the increased motivation for making Show HN submissions does not necessarily imply that the submissions will be better. It will take more time to see of the downward trend of Show HN quality continues over time.

• Data was processed using R and all charts were made using ggplot2.
• You can view the data of all the Show HN submissions and the derived moving averages in this Google Sheet.
• You can view code necessary to reproduce these results and reproduce all the charts in this GitHub repository. This repository also includes a .csv of all ~20,000 Show HNs obtained.

Back then, people were talking about networking, software users, and a little up-and-coming startup known as “Twitter.”

Six years later, during the new renaissance of computing accessibility and startup entrepreneurship, not much has changed.

Hacker News, from 2007 to 2014, always illustrates what’s “new” in technology. After downloading all 1,265,114 Hacker News submissions from the official Hacker News API, I gathered a few interesting statistics which show the true impact of Hacker News.

How many stories are submitted to Hacker News?

In the past few years, Hacker News has had an interesting growth pattern.

From the beginning of 2010 with 12k monthly submissions to to the end of 2011 with 31k monthly submissions, the amount of monthly submissions to Hacker News nearly tripled. It’s a similar growth rate to that of the startups that Y Combinator typically funds.

What’s really interesting is that the end of 2011 is the peak: since then, the amount of submissions has been trending downward. Is Hacker News dying?

I don’t think so. Hacker News implements a proprietary anti-spam algorithm which “kills” submissions, and moderators can kill submissions manually if necessary. Killed articles do not appear in the submission count, so a change in policy would cause the discrepancy. At the least, it helps improve the quality of discussion.

UPDATE (2/28): Paul Graham, in the corresponding HN thread, made a comment that the anti-spam algorithm did indeed increase spam detection and number of article killed at the end of 2011.

How many submissions receive large amounts of points?

On Hacker News, users are able to upvote submissions. The more upvotes a submission has, the higher the position that it appears on the front page of the main site. A simple heuristic for calculating exposure from a Hacker News front page submission is 100 page views per point minimum, which means a submission that earns hundreds of points can go viral very quickly!

But how many submissions actually make it to the front page, and how many actually make it to the top?

On a logarithmic scale, it’s evident that the vast majority of Hacker News submissions don’t even hit 10 points. (the average amount of points for a submission is 9.51). Usually, hitting 10 points is the sign that you’ve appeared on the front page atleast briefly; there, the submission either receives voting momentum or dies quickly due to other rising stars.

But how many submissions do receive hundreds of points? Here’s a chart of submissions by month which have received more than 100 points:

The growth rate of top-scoring submissions is correlated with the growth rate of Hacker News submissions themselves, which is not surprising. The number of points a post receives is also dependent on the number of users; as Hacker News grows, the number of users grows as well. Even though the front page cycles frequently, there is still room for great content.

When is the best time to submit to Hacker News?

The age old question. What is the best time to post such that your post makes it to the front page?

First, let’s see when Hacker News has the most activity by observing the average number of submissions for each combination of submission hour and weekday:

Hacker News activity is most active at around 12 PM EST / 9 AM PST at about 40 submissions per hour, when hackers on the East Coast submit just before eating lunch, and hackers on the West Coast submit just after getting to work. Weekends, unsurprisingly, are completely dead.

If you submitted your link at 12 PM, you’d have a lot competition, but it would be easier to get upvotes since there would be more people visiting the site. If you submitted your post on the weekend, there would be no competition, but would be harder to make the front page.

What is the best weekday + hour to submit such that your submission goes viral? An easy way to estimate the best time is to analyze the times of submission of previous posts with large amounts of points; with enough data (we have enough), it’ll provide a strong guess.

As it turns out, the submission times of posts are uncorrelated with the number of viral posts. There are slightly more when submitting at peak activity (weekdays at 12 PM EST / 9 AM PST), but it won’t make-or-break an article’s success on HN.

Having good content is more important to having a post get to the top of Hacker News. Although you probably shouldn’t submit an article when there’s a major tech event. (e.g. Facebook’s WhatsApp Purchase)

UPDATE (2/28): It’s been pointed out that measuring the proportion of viral posts (number of viral submissions / number of total submissions) would be a better indicator of odds of article success. Since the number of viral submissions is similar across all time zones, the proportion of viral posts would be greatest on the weekends, since there are dramatically fewer total submissions. However, this logic isn’t perfectly correct due to how the article discovery and upvoting system works. I may cover this in a future post.

Do Y Combinator startup announcements score better on HN?

One of the main benefits of Hacker News is to showcase the startups which Y Combinator has funded. Links about YC Startups contain the YC class name of that startup in their title, such as “Watsi (YC W13) raises $1.2M first-of-its-kind philanthropic seed round.” Do these links perform better than the typical links submitted to Hacker News?

As it turns out, yes. For normal posts, the average number of points is 9.5 points, but for YC class announcements, the average is 41.7 points (from 1,745 submissions analyzed).

For fun, which YC classes perform the best on Hacker News?

W06 placed first because of two announcements about Wufoo, and S11 placed second because of CryptoSeal and Parse.

Who are the best submitters on Hacker News?

Like all popular link aggregators, Hacker News has many spammers who submit large amounts of low quality content. Who are the users who submit quality content?

Calculating the average points of a user’s submitted content isn’t an accurate measurement, since that can be heavily skewed by one viral post. Therefore, I created a Hacker News “batting average” statistic: which posters have the highest proportion of posts that make it to the front page vs. the total number submitted? (for posts since 2010 and number of submitted posts >= 10)

It should be no surprise that most of the people on the list are startup founders. It’s also not surprising that most of those founders, such as mwseibel, rahulvohra and tikhon also founded a Y Combinator startup. (although Paul Graham himself only has a 0.856 average).

What are Hacker News’ favorite programming languages?

One of the infamous memes about Hacker News is programming language elitism, with favoritism for languages such as Lisp and Erlang.

But what programming languages are indeed the most popular on Hacker News?

Javascript is very popular, especially with the rising popularity of node.js. Go is unexpectedly frequently submitted for being such a new language. (although it’s possible for “go” to be used in a context outside of a programing language.) Lisp and Erlang are indeed obscure, which might discredit the meme.

Which programming languages are most well-liked on HN?

…so Lisp and Erlang are well-liked on HN.

At the least, in both cases, no one on Hacker News likes PHP.

Snowden and Bitcoin

Edward Snowden’s leaks in June 2013 about the NSA and PRISM affected the entire tech industry, including Hacker News. How did Hacker News react to the leaks?

Strongly.

But after the June spike, discussion about the NSA decreased significantly, but it’s still a popular topic.

Bitcoin is more interesting since it has had three distinct surges:

The June 2011 spike was due to the theft of 25,000 Bitcoin, the April 2013 spike happened during the first rise-and-fall from $200/BTC, and the November 2013 spike happened during the second rise-and-fall from $1,000/BTC.

Hacker News is a great model for a link aggregator. It emphasizes more on quality content than the quantity of content, and it has paid off over the years.

Code for getting all the HN submissions is available on GitHub. Unfortunately, the Hacker News data is too large to distribute freely. Contact me if you want the raw data or any data to reproduce the charts.

Note: there appear to be some gaps in the data for dates before 2010. This appears to be caused by the API server: for example, compare the number of submissions as reported by HN for top user liebke (21) and the number of submissions as reported by the API for liebke (14, with the last 7 submitted stories missing relative to the HN output). Also, number of stories (1,265,114) in the output data and the server data (~1,267,000 as of publishing) are very close, making the discrepancy unlikely caused by client error. As a result, any chart that is based on a time series does not start earlier than 2010.