Postgesql database
Python-based downloader
Hosted on 10.46.0.11
API Key: Redacted
Account linked to: contact@magictoybox.co
Account owner: Michael Bagen
Data Downloader
(name and source of code)
venv
Data Normalizer
Data Normalization Checker
(name and source of code)
venv
(link to schema, including all discussion of normalization)
Server configuration VPN-EXT-DEV (v0.01)
Server configuration VPN-EXT-PROD (v0.01)
(put data validation links here)
TODO: Convert anchor links to separate articles independent of versioning
TODO: Convert list below to a table for better resource inclusion
TODO: For each of the data sources, after they're migrated to their own article, update the data in it, including the source information.
Census Bureau
Bureau of Labor Statistics
Federal Reserve Economics Data (FRED)
Bureau of Econmic Analysis
Securites & Exchange Commission
Census Bureau
The United States Economic Census is the U.S. federal government's official five-year measure of American business and the economy. It is conducted by the U.S. Census Bureau, and response is required by law. Forms go out to nearly 4 million businesses, including large, medium and small companies representing all U.S. locations and industries. Respondents are asked to provide a range of operational and performance data for their companies. Trade associations, chambers of commerce, and businesses use information from the economic census for economic development, business decisions, and strategic planning purposes. The last Economic Census was conducted for the year 2022.
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
| Report | ECN (all us) | ecn2022_us.txt | TXT | ecn2022_us.txt | stg.ecn_2022_us |
| Report | ECN (all states) | ecn2022_st.txt | TXT | ecn2022_st.txt | stg.ecn_2022_states |
| Report | ECN (all counties) | ecn2022_co.txt | TXT | ecn2022_co.txt | stg.ecn_2022_counties |
ECN Basic dat is subject to the following distortions that affect the interrelation between the us, state and county data sets, and will also likely distort its accuracy with respect to other reports measuring the same subject matter.
Suppression
Certain cells (industry × geography) are blanked to protect confidentiality when few establishments would be disclosed.
Location-based establishment counts (not registration)
Counts are tied to the physical location of establishments, not to where the parent firm is incorporated or registered.
Noise infusion / disclosure avoidance
Published values may be rounded or perturbed with statistical noise, so subtotals do not necessarily add up to higher-level totals.
Sampling / coverage (exclusion of nonemployers)
ECN Basic covers employer establishments only. Nonemployers (sole proprietors without payroll) are in the Nonemployer Statistics (NES) dataset.
Address and NAICS coding inconsistencies
Errors in geocoding or classification, or changes in NAICS vintages, can introduce discrepancies between local and national figures.
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
| Report | CBP (all us) | cbp23us.txt | TXT | cbp23us.txt | raw.cbp_2023_us |
| Report | CBP (all ???) | cbp23csa.txt | TXT | cbp23csa.txt | raw.cbp_2023_csa |
| Report | CBP (all ???) | cbp23msa.txt | TXT | cbp23msa.txt | raw.cbp_2023_msa |
| Report | CBP (by state) | cbp23st.txt | TXT | cbp23st.txt | raw.cbp_2023_st |
| Report | CBP (by county) | cbp23co.txt | TXT | cbp23co.txt | raw.cbp_2023_co |
| Report | CBP (by state) | cbp23pr_ia_st.txt | TXT | cbp23pr_ia_st.txt | stg.cbp_2023_ia_st_raw |
| Report | CBP (by county) | cbp23pr_ia_co.txt | TXT | cbp23pr_ia_co.txt | stg.cbp_2023_ia_co_raw |
| Report | CBP (all ???) | zbp23detail.txt | TXT | zbp23detail.txt | stg.cbp_2023_detail_raw |
| Report | CBP (all ???) | zbp23totals.txt | TXT | zbp23totals.txt | stg.cbp_2023_totals_raw |
ECN Basic dat is subject to the following distortions that affect the interrelation between the us, state and county data sets, and will also likely distort its accuracy with respect to other reports measuring the same subject matter.
Suppression
Employment and payroll cells may be withheld where few establishments exist, to protect confidentiality.
Location-based establishment counts
Counts reflect establishments’ operating addresses, not parent company registration.
Disclosure avoidance
Published values may include noise infusion or controlled rounding, so county totals do not exactly sum to state or national totals.
Coverage
CBP includes employer establishments only. Nonemployers are excluded and must be sourced from NES.
NAICS classification
Subject to industry coding changes over time; vintages differ across releases.
ECN Basic dat is subject to the following distortions that affect the interrelation between the us, state and county data sets, and will also likely distort its accuracy with respect to other reports measuring the same subject matter.
Scope
Covers businesses without paid employees (sole proprietors, partnerships, etc.) based primarily on IRS tax return data.
Location-based counts
Assigned by mailing or reported address, not necessarily where economic activity occurs.
Disclosure avoidance
Noise infusion and suppression methods apply, so local data may not sum to national totals.
Comparability
Cannot be directly added to CBP or ECN counts without adjustment, since employer and nonemployer definitions differ.
Classification
Industry coding (NAICS) follows reported information; some businesses may be miscoded or classified inconsistently.
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
| Variables | ACS (c profile) | acs5_cprofile_vars_2023.json | JSON | acs5_cprofile_vars_2023.json | raw.acs_cprofile |
| Variables | ACS (profile) | acs5_profile_vars_2023.json | JSON | acs5_profile_vars_2023.json | raw.acs_profile |
| Variables | ACS (subject) | acs5_subject_vars_2023.json | JSON | acs5_subject_vars_2023.json | raw.acs_subject |
| Variables | ACS (detailed) | acs5_detailed_vars_2023.json | JSON | acs5_detailed_vars_2023.json | raw.acs_detailed |
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|
xxx
| Type | Report | Link | Format | Saved file(s) | Intended table |
|---|---|---|---|---|---|