Scrape Hacker News

This document outlines the functionality and characteristics of the Scrape Hacker News node, which enables automated content retrieval from Hacker News.

​

Node Inputs

​

Optional Fields

• Query: Keywords to filter news articles by title
• Num Pages: Number of pages to scrape (maximum: 5)

​

Node Output

• Post Titles: List of matching article titles
• Post Links: List of corresponding article URLs

​

Node Functionality

The Scrape Hacker News node retrieves and filters content from Hacker News.

Key features include:

• Keyword-based filtering
• Multi-page scraping
• Front page focus
• Title and URL extraction
• Automatic content parsing

​

When To Use

The Scrape Hacker News node is valuable for tech news monitoring. Common use cases include:

• Tech Monitoring: Track specific technology trends
• Market Research: Follow startup and industry news
• Competition Analysis: Monitor tech landscape
• Content Curation: Gather relevant tech articles

Some specific examples:

• Tracking AI/ML developments
• Monitoring startup funding news
• Following specific tech company mentions
• Gathering programming language discussions

​

Important Considerations:

1. Maximum 5 pages per request
2. Results are in chronological order

In summary, the Scrape Hacker News node provides efficient tech news monitoring through automated content filtering and retrieval from Hacker News.