Chapter 7: External Source Data Collection

Chapter 7: External Source Data Collection — ThinkNavi User Manual

Chapter 7: External Source Data Collection

7.1 Online Article Search

Search and collect latest news articles using Google News RSS. No API key required.

Steps:

  1. Select the “Online Articles” tab in the left sidebar
  2. Enter search keywords (Japanese or English)
  3. Click the “Search” button
  4. Results appear in the table

Result Table Columns:

  • Title
  • URL
  • Source (media name)
  • Publication date
  • Summary (snippet)

Additional Operations:

  • Save results with “Save as CSV”
  • Auto-tag articles with Auto-Code

Limitations:

  • Google News RSS covers only recent news. Articles from several months ago may not be found
  • Search results depend on Google’s RSS feed content
  • Up to approximately 100 results per search

Search academic paper metadata (title, authors, abstract, publication year, DOI, etc.) from multiple databases.

Selecting a Search Source

Switch search sources using the dropdown at the top of the screen.

SourceCostMax ResultsFeaturesAPI Key
OpenAlexFree200Comprehensive academic paper database. RecommendedNot required
Semantic ScholarFree100AI-filtered paper databaseNot required
arXivFree200Preprints. Strong in physics, CS, mathNot required
IEEE XplorePaid200IEEE/IET electrical, electronic, information papersRequired

Running a Search

  1. Select a search source from the dropdown
  2. Enter a search query (e.g., “machine learning natural language processing”)
  3. Click the “Search” button
  4. Results appear in the table

Result Table Columns:

  • Title
  • Authors
  • Abstract / Summary
  • Year
  • DOI
  • Source (journal name, etc.)
  • Citation Count (available depending on source)

Working with Results

  • Duplicate Detection: Papers with the same DOI are automatically flagged
  • No-abstract Filter: Filter out papers without abstracts
  • Auto-Coding: AI automatically assigns theme codes to papers
  • CSV Export: Download including code columns

IEEE Xplore Setup

To use IEEE Xplore, you need to obtain an API key from the IEEE Developer Portal.

  1. Visit the IEEE Developer Portal (https://developer.ieee.org/)
  2. Create an account and obtain an API key
  3. Enter the key in the “IEEE Xplore API Key” field on the ThinkNavi Settings page

Search US patents using the USPTO (United States Patent and Trademark Office) PatentsView API. No API key required.

Steps:

  1. Select the “Patent Information” tab in the left sidebar
  2. Enter search keywords in English (e.g., “neural network text classification”)
  3. Click the “Search” button

Result Table Columns:

  • Patent Number
  • Title
  • Abstract
  • Filing Date
  • Grant Date
  • Inventors
  • Assignee

Notes:

  • Only US patents are searched (USPTO database)
  • Enter search keywords in English
  • Results can be saved as CSV

7.4 Troubleshooting

IssueCause and Solution
Online article search returns 0 resultsChange keywords. Niche keywords may return few results
Academic paper search is slowSemantic Scholar or arXiv may be slow due to server congestion. Wait and retry
“API Key Error” with IEEE searchVerify that the IEEE Xplore API key is correctly registered in Settings
Can’t use Japanese keywords for patent searchUSPTO supports English only. Convert keywords to English for searching
Search results have empty abstractsNot all papers have abstracts registered. Use the no-abstract filter to exclude them