Tuesday, July 21, 2015

In March I participated in a hackathon for journalism and data in New Jersey. The following is a list of open data sources they provided us to aid us in our team projects.



Click below to jump to topic
APIs /// Budget and Spending /// Business and Finance /// Campaign Finance /// Census and Demographics /// Crime and Corrections /// City Open Data Repositories /// Education /// Elections /// Disaster Relief /// Environment, Pollution and Wildlife /// Health /// Housing and Real Estate /// Human Services /// Infrastructure /// Labor /// Legislature /// Mapping and Shapefiles /// Miscellaneous /// Non-profits and Charities /// Pensions /// Transportation and Safety /// Taxes /// Veterans /// Weather

APIs

— Sunlight Foundation has seven APIs, including campaign finances and voting records [editor’s note: Sunlight’s APIs power these apps, so don’t replicate anything already here, http://sunlightfoundation.com/projects/ ]

New Jersey Boundary Service API

U.S. Census API

Facebook API

Foursquare API

Twitter API,

Untappd API

Yelp API

FDA API

Parse.ly API

Bizyhood API
Click to scroll back to top menu

Budget and spending

— The latest Budget Data released in the state Data Portal.

— NJ State Transparency Center has online query tools and PDF-based reports

— The latest Port Authority payrolls (in 2014)
Click to scroll back to top menu

Business and Finance

NJ Business Records Service has a form-based query that may require some scraping to access data

List of New Jersey banks, from the NJ Division of Banking and Insurance

— Financial Institution Statistics, from the Treasury Department, state-level data

— Insurance and Licensing, from NJ Division of Banking and Insurance
Click to scroll back to top menu

Campaign finance

NJ ELEC’s campaign finance databases, with downloads of reports for some races and PDF filings for local elections

Federal Election Commission data

FEC-Scraper, Python library for handling FEC data

Fech, Ruby library for doing the same
Click to scroll back to top menu

Census and Demographics

— American Fact Finder, the main search tool for digging into the Census’ data sets.

Census Reporter, easy-to-use tool for journalists to find and visualize Census data

— Rutgers’ New Jersey Data Book, online source for many New Jersey demographic datasets, goes down to the municipality-level
Click to scroll back to top menu

Crime and corrections

NJ State Police statistics on crime, gang activity and accidents. Data is mostly in PDF formats and would require some OCR and massaging to unlock

FBI Uniform Crime Reports

NJ Registered sex offender database, with query-based data retrieval

NJ Department of Corrections inmate finder, with form-based queries

Arrest-related deaths 2004-2014, from NJ Advance Media “Kenwin Garcia” project

Juvenile Justice Commission data, weekly statistics since 2011 in PDFs
Click to scroll back to top menu

City Open Data Repositories

Hoboken’s Open Data site

Jersey City’s Official Data site

Jersey City Open Data portal, a searchable repository of Jersey City data

Newark Open Data portal
Click to scroll back to top menu

Education

NJ Department of Education data, one stop shop for everything data in New Jersey

— NJDOE’s Electronic Violence and Vandalism Reporting System, contains school weapons, fights, assault, bomb threats, bullying incidents, etc.

College Campus Safety and Security Data, from U.S. Department of Education, has data on alleged criminal offenses reported to campus security authorities and/or local law enforcement agencies.
Click to scroll back to top menu

Elections

NJ Election Information and Results Archive, with historical returns mostly in PDF

Disaster relief

Federal Emergency Management data feeds and APIs

FEMA flood maps

Federal Procurement Data System

Sandy Programs and Disbursement data on the state’s Data Portal
Click to scroll back to top menu

Environment, pollution and wildlife

NJ Department of Environmental Protection’s Data Miner, with form-based data retrieval

Contaminated brownfield remediation

Air Quality data

Wildlife, fishing and hunting information

NJ Bear Hunt Data

Farmland preservation

Drought data

— Profile of New Jersey’s energy emissions, consumptions and alternative fuel use, from US Energy Information Administration

Toxics Release Inventory (TRI) Program data, from the Environmental Protection Agency
Click to scroll back to top menu

Health

State inspection report cards for hospitals, nursing homes and other facilities, may require some scraping.

CMS Open Payments database & ProPublica’s Dollars for Docs project, both contain data on money received by doctors from pharmaceutical companies.

Data.Medicare.gov, has quality measure comparisons for nursing homes, hospitals, home health and physicians.

New Jersey Prescription Drug Price Registry

Affordable Care Act (Obamacare) plan premium prices, down to the county-level

— FDA API, contains adverse reactions and recalls for drugs, devices and foods

Patient data breaches in medical facilities
Click to scroll back to top menu

Housing and Real Estate

Building Permit data, monthly, also going back since 2000

— Foreclosure Statistics, from the State Division of Banking

— Zillow Real Estate Data

Property Assessment records
Click to scroll back to top menu

Human Services

— Family Development, food stamp, child services data, along with WorkFirst New Jersey Program.

— FamilyCare Enrollment, enrollment data on the state’s FamilyCare Program.

— New Jersey Division of Addiction Services, Substance Abuse Statistics

— Substance Abuse Treatment Reports, the state’s annual performance reports from substance abuse treatment centers

— Intoxicated Driving Program Reports, from the state’s Intoxicated Driving Program

— Epidemiological Reports,  issued annually by NJ Dept. of Human Services
Click to scroll back to top menu

Infrastructure

National Bridges inventory

National Dams Directory
Click to scroll back to top menu

Labor

NJ Department of Labor’s State Data Center

State labor force estimates and unemployment data

OSHA enforcement inspections
Click to scroll back to top menu

Legislature

State legislature FTP, has bills, laws, votes and bill tracking information from the current and past sessions
Click to scroll back to top menu

Mapping & Shapefiles

— The NJ Geographic Information Network (NJGIN)

NJ Office of GIS

— State Department of Environmental Protection GIS data

— State Department of Transportation GIS data, includes roads and highways

— NJ Transit rail GIS data and bus GIS data
Click to scroll back to top menu

Miscellaneous

Professional licensing data, with form-based data retrieval queries

Asbury Park Press’ Data Universe

Society of Professional Journalists tool box with links to public records

NJ DataBank, a repository of policy reports and data on various topics

— NJ Child Care licensing data
Click to scroll back to top menu

Nonprofits & charities

Directory of registered New Jersey charities

IRS master file of tax exempt organizations
Click to scroll back to top menu

Pensions

Active and Retired State Pension Data
Click to scroll back to top menu

Transportation and Safety

— State Department of Transportation data, includes tons of transportation data, including downloads of raw accident databases, GIS data and roadway usage

— All of Hudson County Public Transportation GIS data, courtesy of @FakeGreenDress

511 Traffic info with form-based data query that could be scraped

NJ Transit Developer site (need to sign up with a free account) contains GTFS schedule data and rail advisory feeds

— Five months of PATH ridership Turnstile data

Federal Rail Administration data, includes railroad accident data, among other things
Click to scroll back to top menu

Taxes

— State Department of Community Affairs’ Property Tax data

— State Department of Treasury tax data

Property ownership records