Sources Referential¶
Table of Contents
- Sources Referential
- Standards
- Sources
- IN-PROGRESS African Development Bank
- IN-PROGRESS Asian Development Bank
- IN-PROGRESS Australian Bureau of Statistics
- Bank of International Settlements
- IN-PROGRESS Belgium
- IN-PROGRESS Brazil
- IN-PROGRESS Canada
- IN-PROGRESS China
- IN-PROGRESS CIRCAB
- CME groupe
- IN-PROGRESS ECB SDW
- IN-PROGRESS EUROSTAT
- IN-PROGRESS FAO
- Germany
- Greece
- IN-PROGRESS IMF
- IN-PROGRESS India
- IN-PROGRESS INSEE
- IN-PROGRESS ISTAT
- IN-PROGRESS Japan
- IN-PROGRESS Luxembourg
- IN-PROGRESS Madagascar
- IN-PROGRESS Monaco
- National Bureau of Statistics of China
- IN-PROGRESS Netherlands
- OECD
- IN-PROGRESS Portugal
- IN-PROGRESS Russia
- IN-PROGRESS Sweden
- IN-PROGRESS South Korea
- IN-PROGRESS Spain
- IN-PROGRESS Swiss
- IN-PROGRESS United Nations
- IN-PROGRESS United Kingdom
- IN-PROGRESS USA
- World Bank
- Related projects
Standards¶
IN-PROGRESS SDMX¶
- Standards for the exchange of statistical information
- Raw data : SDMX-ML(XML),SDMX-EDI(EDIFACT)
- DSD: Data Structure Definition, logical container for specific data with specific format
- Dimension/attribute, identifier, attachement level, code list
- Concept scheme : Dimension(time,country,frequency,topic), Attributes(observation statsus:estimated or provisional), Measures(observation values)
- SDMX Compact, Query
- Cross domain concept
- Provision agreement: describes the way of delivering data in specific DSD at certain period
- SDMX registry: central online repositery
- SDMX Technical speficiations:Preparation, SDMX compliance with DSD standard, implementation(installed), production
- Sponsor: BIS, ECB, Eurostat, IMF, OECD, UN, World Bank
- Rest(SDMX2.1): URL with a keyfilter and a periodfilter
- http://sdmx.org
- https://webgate.ec.europa.eu/fpfis/mwikis/sdmx/index.php/Main_Page
- http://sdmx.wikispaces.com/
- http://opensdmx.wikispaces.com/Presentations
- SDMX-JSON:
- SDMX ISO: 17369
TODO Others¶
TODO RDF¶
- Resource Description Framework respresentation : metadata data model.
General method for conceptual description or modeling of information that is implemented in web resources, using a variety of syntax notations and data serialization formats.
TODO SAX¶
- Simple API for XML (Faster and less memory than DOM)
TODO XLST¶
- eXtensible Stylesheet Transformation of XML
IN-PROGRESS RSS¶
- Really Simple Syndication: RSS feeds enable publishers to syndicate data automatically
Sources¶
IN-PROGRESS African Development Bank¶
- http://dataportal.afdb.org didn’t work on 12/28/2013
- xls,pdf?
IN-PROGRESS Asian Development Bank¶
- files download at https://sdbs.adb.org/sdbs/index.jsp. Yearly data. CSV. PDF file?
- files download at http://aric.adb.org/macroindicators, monthly quaterly yearly indicators. HTML or Excel files.
IN-PROGRESS Australian Bureau of Statistics¶
Bank of International Settlements¶
- CSV, Excel, SDMX-ML, URL of favorties queries
IN-PROGRESS Belgium¶
IN-PROGRESS Statistics Belgium¶
- Excel format, could be difficult to download
- http://statbel.fgov.be/fr/statistiques/chiffres/population/
IN-PROGRESS Brazil¶
IN-PROGRESS Intituto Brasileiro de Geographia e Estatistica¶
- XLS http://downloads.ibge.gov.br/downloads_estatisticas.htm
- XLS http://servicodados.ibge.gov.br/Download/Download.ashx?u=ftp.ibge.gov.br/Contas_Nacionais/Contas_Nacionais_Trimestrais/Tabelas_Completas/Tab_Compl_CNT.zip
- http://www.ibge.gov.br/english/default.php
- http://downloads.ibge.gov.br/downloads_estatisticas.htm
- pdf, ods, xls
IN-PROGRESS Canada¶
- Statistique Canada
- http://www.statcan.gc.ca/concepts/index-fra.htm?MM
IN-PROGRESS China¶
IN-PROGRESS National Bureau of Statistics of China¶
- no API? Only web page?
- XLS, until 2011 : http://www.stats.gov.cn/tjsj/ndsj/2012/html/
- XLS, until 2012 : http://www.stats.gov.cn/tjsj/ndsj/2013/html/
IN-PROGRESS CIRCAB¶
- Communication and Information Resource Centre for Administrations, Businesses and Citizens.
- https://circabc.europa.eu/faces/jsp/extension/wai/navigation/container.jsp
- http://ec.europa.eu/idabc/en/document/7400.html
- forge.osor.eu/projects/circabc
CME groupe¶
- http://www.cmegroup.com
- data on future and option market
- proprietary data, can’t be used on our web site
IN-PROGRESS ECB SDW¶
- http://sdw.ecb.europa.eu/
- SDMX(ML/query), CSV (excel and )
- https://www.ecb.europa.eu/stats/services/sdmx/html/tutorial.en.html
IN-PROGRESS EUROSTAT¶
- SDMX(REST,SOAP with ZIP),TSV, DFT(multi-dimensional table) with GZ
- Html explorator online search with New (data and DSD) and Modified online search
IN-PROGRESS FAO¶
- SDMX registry and repo, SDMX-ML
- data.fao.org
Germany¶
Federal Statistical Office and the statistical Offices of the Länder¶
IN-PROGRESS DESTATIS¶
- Federal Statistical Offiice of Germany
- no download or API?
- https://www.destatis.de/EN/Homepage.html
Greece¶
hellenic Statistical Authority(EL.STAT.)¶
- http://www.statistics.gr/portal/page/portal/ESYE/PAGE-database
- anonymous users there is an upper limit of 500 records you can extract from the Statistical Database
- XLS, CSV, TEXT
- Difficukt to automatize
IN-PROGRESS IMF¶
- the data in eLibrary don’t seem to be free
- http://www.imf.org/external/data.htm
- World Economic Outlook database: (Tab Delimited Values format) http://www.imf.org/external/pubs/ft/weo/2013/02/weodata/download.aspx
- User Query Test Interface : http://sdmxws.imf.org/Gateway/Home.aspx
- IMF Balance of Payments Pilot SDMX Data Dissemination Site with DSD in XML or excel: http://sdmx.imf.org/bop/
IN-PROGRESS INSEE¶
- Banque de données macro-économiques (BDM)(server unavailable?): consult and download more than 170.000 series and index over all economics and social area
IN-PROGRESS ISTAT¶
- Equivalent of INSEE: old version before 2012 Con.ISAT short term indicator time-series database :prices, industry, services, wages and salaries, employment and labour indicators, foreign trade, national accounts )
- SDMX ML, CSV, excel, beta version,open and free, online API: http://dati.istat.it/
- EUROSTAT SODI (SDMX Open Data Interchange) for exchanging PEEIs (Principal Economical European Indicators) :
- private logging http://sodi.istat.it/progettosodiDW/ or http://bms.istat.it/sodidownload/download.aspx
- https://joinup.ec.europa.eu/community/osor/description
- SDMX is not working?
IN-PROGRESS Japan¶
Statistics of Japan¶
- API in Japanese only http://www.stat.go.jp/english/info/news/1957.htm
Bank of Japan¶
- no API? Only files?
IN-PROGRESS Madagascar¶
National Bureau of Statistics of China¶
- no API? Only web page?
- XLS, until 2011 : http://www.stats.gov.cn/tjsj/ndsj/2012/html/
- XLS, until 2012 : http://www.stats.gov.cn/tjsj/ndsj/2013/html/
IN-PROGRESS Netherlands¶
Statistics Netherlands (CBS)¶
- Statline : http://statline.cbs.nl/StatWeb/?LA=en
OECD¶
OpenDataAPI¶
- http://stats.oecd.org/OpenDataAPI/OData.html
- not all datasets seems to be available with this API
SDMX-JSON API¶
- http://stats.oecd.org/OpenDataAPI/Json.htm
- SDMX-JSON API is easier and more concise than OData. Data and metadata are obtained in a single call
- The list of datasets must be obtained with OData
IN-PROGRESS Russia¶
IN-PROGRESS Sweden¶
Statistics Sweden¶
- Statistics Sweden
- PC, excel, csv, tsv
IN-PROGRESS Spain¶
IN-PROGRESS ILO¶
- no API, download files
- old database: laborstat, CSV, http://laborsta.ilo.org/
- new database: ilostat, CSV (, TAB ;) http://www.ilo.org/ilostat/faces/home/statisticaldata/bulk-download?_adf.ctrl-state=hlizkfzwc_98&clean=true&_afrLoop=368699868737048
- SDMX http://www.ilo.org/ilostat/sdmx/ws/rest/
IN-PROGRESS INE¶
IN-PROGRESS United Nations¶
IN-PROGRESS National accounts (Excel files)¶
- http://unstats.un.org/unsd/snaama/dnlList.asp. Easy to download with wget type tool https://www.gnu.org/software/wget/
Monthly Bulletin of Statistics Online (MBS)¶
World Bank¶
IN-PROGRESS General information on API¶
- http://data.worldbank.org/node/9
- RESTful interfaces
- Indicators (or time series data): API, XML and JSON
- Projects (or data on the World Bank’s operations) : Atom representation
- the World Bank financial data (World Bank Finances API):API, XML, JSON and RDF