CrackSearchEngine All articles
Investigative Methods

Hidden in Plain Sight: 20 Obscure Federal Databases Every Serious Researcher Should Know

CrackSearchEngine

Data.gov lists over 300,000 datasets. Most researchers visit the same dozen. The remainder — sprawling, granular, sometimes extraordinarily revealing — sit largely untouched, indexed but unexplored.

At CrackSearchEngine, surfacing hard-to-find information is the mission. This guide profiles 20 federal databases that fall well outside the standard research toolkit, organized by agency. Each entry explains what the data contains, how to retrieve it, and where it has already proven its investigative value.

Food and Drug Administration

1. FDA Adverse Event Reporting System (FAERS) FAERS is the FDA's repository of voluntary and mandatory reports describing adverse events, medication errors, and product quality complaints associated with drugs and biologics. Physicians, pharmacists, patients, and manufacturers all submit reports. The database is searchable through the FDA's public dashboard and available for bulk download. Investigative journalists have used FAERS to identify patterns of underreported side effects that preceded formal safety label changes.

2. Manufacturer and User Facility Device Experience (MAUDE) The medical device equivalent of FAERS. MAUDE catalogs reports of suspected device-associated deaths, serious injuries, and malfunctions. ProPublica's reporting on surgical mesh complications drew substantially on MAUDE records to document injury patterns that manufacturers disputed.

3. FDA Inspection Database The FDA conducts thousands of facility inspections annually. Warning letters, Form 483 observations, and import alerts are publicly accessible through FDA.gov. Researchers tracking pharmaceutical supply chain integrity or food safety failures will find this database essential.

Environmental Protection Agency

4. Toxics Release Inventory (TRI) Under the Emergency Planning and Community Right-to-Know Act, industrial facilities must annually report releases of hundreds of toxic chemicals to air, water, and land. TRI Explorer allows users to query by facility, chemical, geography, and year. Community organizations have used TRI data to identify disproportionate pollution burdens in low-income neighborhoods — a practice central to environmental justice research.

5. Enforcement and Compliance History Online (ECHO) ECHO consolidates EPA compliance and enforcement records for air, water, and hazardous waste regulations. Researchers can identify facilities with chronic violations, track penalty histories, and map enforcement gaps by region. ECHO has been used by journalists to document the gap between documented violations and actual enforcement action.

6. Air Quality System (AQS) AQS contains ambient air quality monitoring data collected by EPA, state, local, and tribal agencies going back decades. Granular enough to analyze by monitor location, pollutant, and time period, it is an indispensable resource for epidemiological research linking air quality to health outcomes.

7. EJSCREEN EPA's environmental justice mapping tool combines environmental and demographic data to identify communities facing compounded pollution burdens. Researchers studying health disparities, housing policy, or industrial siting decisions will find EJSCREEN provides a powerful geographic framing for their analysis.

Department of Agriculture

8. National Pesticide Information Retrieval System (NPIRS) / IR-4 Data The EPA's pesticide registration database (accessible through the USDA's agricultural research infrastructure) catalogs every registered pesticide product in the United States, including formulation details, approved uses, and tolerance levels. Investigative reporters have used registration records to track the approval histories of chemicals that later faced regulatory scrutiny.

9. USDA Agricultural Marketing Service Pesticide Data Program (PDP) The PDP tests fresh and processed foods for pesticide residues annually. The resulting datasets — publicly downloadable — allow researchers to analyze residue levels by commodity, pesticide, and year. Academic researchers have used PDP data to evaluate the effectiveness of tolerance standards.

10. Farm Service Agency (FSA) Payment Data The USDA publishes data on farm subsidy payments through the FSA, including recipient names, payment amounts, and program types. Environmental Working Group's Farm Subsidy Database built its entire analytical framework on this data, revealing that a substantial share of subsidies flows to large operations rather than small family farms.

Department of Labor

11. OSHA Injury and Illness Data Employers with 20 or more employees in high-hazard industries must electronically submit injury and illness records to OSHA. The resulting dataset is publicly available and allows researchers to compare safety performance across facilities, industries, and ownership structures. Journalists have used this data to identify facilities with injury rates far exceeding industry averages.

12. Mine Safety and Health Administration (MSHA) Data Files MSHA maintains detailed records on mine accidents, injuries, illnesses, and inspections. The data extends back decades and covers both surface and underground operations. Researchers studying occupational health in extractive industries treat MSHA's bulk data files as a foundational resource.

Department of Transportation

13. Pipeline and Hazardous Materials Safety Administration (PHMSA) Incident Data PHMSA collects reports of incidents involving pipelines, hazardous materials in transit, and liquefied natural gas facilities. The incident database is downloadable and includes cause codes, commodity types, and consequence data. This resource has supported both academic risk analysis and journalism following high-profile pipeline failures.

14. Federal Aviation Administration (FAA) Wildlife Strike Database Somewhat niche but remarkably detailed, the FAA's wildlife strike database records every reported collision between aircraft and wildlife. Beyond aviation safety research, it has been used by ecologists studying bird migration patterns near airports.

Financial and Corporate Data

15. SEC EDGAR Full-Text Search While EDGAR is widely known, its full-text search capability — allowing keyword queries across all filings — remains underutilized. Researchers can locate mentions of specific chemicals, litigation, or geographic locations buried in 10-K disclosures and proxy statements. Financial journalists use full-text EDGAR searches to surface corporate admissions that never appear in press releases.

16. Federal Election Commission (FEC) Bulk Data The FEC publishes complete contribution and expenditure data for federal elections. Beyond the standard donor lookups, the bulk data files enable analysis of PAC networks, bundling patterns, and the flow of money between political committees — work that individual candidate pages cannot support.

Health and Human Services

17. Health Resources and Services Administration (HRSA) Area Health Resources Files (AHRF) AHRF aggregates over 6,000 variables related to health care resources, utilization, and demographics at the county and state levels. Researchers studying health care access, physician shortages, or rural health disparities rely on AHRF as a master reference dataset.

18. CMS Medicare Provider Utilization and Payment Data The Centers for Medicare and Medicaid Services publishes annual data on procedures billed by individual physicians and hospitals, including volumes and payment amounts. ProPublica's "Dollars for Docs" investigation used CMS data to identify physicians with unusually high billing patterns in specific procedure categories.

Additional Federal Resources

19. National Highway Traffic Safety Administration (NHTSA) Complaints Database Consumers and dealers file complaints with NHTSA about vehicle defects and safety concerns. The complaints database — searchable and downloadable — has been used by journalists and researchers to identify emerging defect patterns before formal recalls are issued.

20. Bureau of Justice Statistics (BJS) National Crime Victimization Survey (NCVS) Microdata The NCVS is the nation's primary source of information on criminal victimization, including crimes not reported to police. Through the Inter-university Consortium for Political and Social Research (ICPSR), researchers can access the underlying microdata — a far richer resource than published summary tables — to conduct original analysis of victimization patterns, reporting behavior, and demographic disparities.

Putting the Pieces Together

The datasets described above share a common characteristic: they were built to serve regulatory and administrative functions, not research audiences. That origin means they are often poorly documented, inconsistently formatted, and buried beneath agency web architectures that prioritize public relations over data access.

The payoff for navigating those obstacles, however, is substantial. These databases contain primary records — not summaries, not press releases, not agency-approved narratives. They contain the underlying evidence from which consequential stories, studies, and policy arguments can be constructed.

The federal government is, in this sense, one of the most prolific publishers of raw data in the world. The challenge has never been the existence of the information. It has always been knowing where to look.

All Articles

Keep Reading

Who Paid for That Study? A Researcher's Guide to Tracing the Money Behind Science

Who Paid for That Study? A Researcher's Guide to Tracing the Money Behind Science

Beyond the Paywall: Legitimate Pathways to Locked Academic Research

Unlocking the Vault: 50+ Federal Databases Hiding in Plain Sight

Unlocking the Vault: 50+ Federal Databases Hiding in Plain Sight