Open Data portals

[vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=”” css=”.vc_custom_1456865212767{margin-bottom: 20px !important;}”][vc_column][vc_column_text]Finding open data on the web takes you on a journey between hubs, portals, pages and sites. Searches on Google show that apart from a peak in early 2004, there has been a steady rise in interest in open data pages and portals. [/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”center” background_image_as_pattern=”without_pattern” css_animation=””][vc_column][vc_raw_js]JTNDc2NyaXB0JTIwdHlwZSUzRCUyMnRleHQlMkZqYXZhc2NyaXB0JTIyJTIwc3JjJTNEJTIyJTJGJTJGd3d3Lmdvb2dsZS5jby51ayUyRnRyZW5kcyUyRmVtYmVkLmpzJTNGaGwlM0Rlbi1HQiUyNnElM0RvcGVuJTJCZGF0YSUyQnBvcnRhbCUyQyUyQm9wZW4lMkJkYXRhJTJCaHViJTJDJTJCb3BlbiUyQmRhdGElMkJleGNoYW5nZSUyQyUyQm9wZW4lMkJkYXRhJTJCc2l0ZSUyQyUyQm9wZW4lMkJkYXRhJTJCcGFnZSUyNmNtcHQlM0RxJTI2dHolM0RFdGMlMkZHTVQlMjZ0eiUzREV0YyUyRkdNVCUyNmNvbnRlbnQlM0QxJTI2Y2lkJTNEVElNRVNFUklFU19HUkFQSF8wJTI2ZXhwb3J0JTNENSUyNnclM0Q5MDAlMjZoJTNENDAwJTIyJTNFJTNDJTJGc2NyaXB0JTNF[/vc_raw_js][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=”” css=”.vc_custom_1456865212767{margin-bottom: 20px !important;}”][vc_column][vc_column_text]At the heart of the MediaMill project are two local government open data sites- Leeds DataMill and York Open Data.  These are two of a small but growing number of what are commonly called open data portals which offer a dedicated place to find open government data. But what makes an open data portal?  [/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=”” css=”.vc_custom_1456785777394{margin-bottom: 30px !important;}”][vc_column width=”1/2″][vc_column_text css=”.vc_custom_1458556853642{margin-top: 8px !important;}”]Leigh Dodds, chair of bathhacked, argues that an open data portal is a “list of datasets with pointers to how those datasets can be accessed” – a web page on an existing website meets this criteria, “It’s the minimum viable open data portal”. Dodds points out however, that once you have more than a handful of data sets you’ll need something more functional. [/vc_column_text][vc_column_text css=”.vc_custom_1456863466491{margin-top: 8px !important;}”]The functionality of open data portals tends to fall into two areas;[/vc_column_text][unordered_list style=”circle” animate=”no”]
  • Discoverability  – whilst search engines are good at searching webpages, a system that can practically store and organise data needs to create good supporting information such as meta data to make it ‘findable’ 
  • Interoperability – a data portal needs a clear method for accessing the data in a way that makes it easy to combine data from various sources. This would most commonly be done programmatically so the focus here is on providing a good API to access the site
[/unordered_list][/vc_column][vc_column width=”1/2″][vc_column_text] 
 

A count of platforms used for open data platforms based on our research and the list from Nesta’s Local Open Data Ecosystems map [/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=”” css=”.vc_custom_1456865212767{margin-bottom: 20px !important;}”][vc_column][vc_column_text]There are a growing number of open data portal platforms that aim to meet these needs, many of them off-the-shelf. In the UK, the range of platforms in use by these ‘next step’ open data portals is limited, in part by the small numbers of portals. Based on the sites we’ve been exploring and the list compiled as part of Ed Parkes and Gail Dawes’ work on a prototype map of the local open data ecosystems we’ve created a short overview of the platforms in use.[/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=””][vc_column width=”1/4″][vc_single_image image=”15936″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

Datashare.

[/vc_column_text][vc_column_text]The DataShare platform was developed by an in-house team at the London Borough of Redbridge Council to meet the demands of the transparency act in an efficient and cost effective way. Like many open data initiatives it was funded partly through LGA who agreed to sponsor 100 free licences. It was brought to market in partnership with the Chartered institute of Public Finance and Accountability.[/vc_column_text][vc_column_text css=”.vc_custom_1458554802175{margin-top: 10px !important;margin-bottom: 10px !important;}”]Licensed Self-hosted[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15938″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

Custom

[/vc_column_text][vc_column_text]With many of the data portals we looked at as part of this research,  it wasn’t clear what platform was used.  A number of sites used open source publishing platforms like WordPress and Joomla but others offered a level of functionally that suggested some custom development.[/vc_column_text][vc_column_text css=”.vc_custom_1456872074825{margin-top: 10px !important;margin-bottom: 10px !important;}”]Open Source  Software as a service   Commercial Licensed Self-hosted[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15934″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

CKAN

[/vc_column_text][vc_column_text]The Comprehensive Knowledge Archive Network (CKAN) is an open source open data hub. Created in 2006 and originally maintained by Open Knowledge, CKAN is now managed by a subsidiary company Viderum. Surpluses generated by Viderum go back to Open Knowledge. The open source nature of CKAN means it forms the backbone of many open data portals including other applications on this list.[/vc_column_text][vc_column_text css=”.vc_custom_1458553730589{margin-top: 10px !important;margin-bottom: 10px !important;}”]Open Source  Software as a service   Self-hosted[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15942″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

InstantAtlas

[/vc_column_text][vc_column_text]The Instantatlas platform owned by Geowise which is part of ESRI (Environmental Systems Research Institute) network. The aim is to make it easy to generate interactive and accessible reports from complex data. The compatibility with GIS (geographic information system ) is an attractive option for councils who have invested heavily in GIS software. [/vc_column_text][vc_column_text css=”.vc_custom_1458554835411{margin-top: 10px !important;margin-bottom: 10px !important;}”]Software as a service   Commercial Licensed[/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=”” css=”.vc_custom_1456865228119{margin-bottom: 40px !important;padding-right: 10px !important;padding-left: 10px !important;}”][vc_column width=”1/4″][vc_single_image image=”15939″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

Socrata

[/vc_column_text][vc_column_text]Socrata is a US open data portal company.  It was founded in 2007 out of a company called Blist who created a web-based database application.  They offer a suite of applications based around open government and are the dominant player in the US market. Their main open data portal product is Socrata Open Data[/vc_column_text][vc_column_text css=”.vc_custom_1458556257146{margin-top: 10px !important;margin-bottom: 10px !important;}”]Software as a service   Commercial Licensed[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15940″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

DataPress

[/vc_column_text][vc_column_text]DataPress integrates CKAN with popular blogging platform WordPress to balance the publishing of data and content around that data. Originally developed in part with support from the ODI’s startup programme. the Datapress service includes hosting and implementation. The platform is currently used to power the London data store and Leeds data mill amongst others. [/vc_column_text][vc_column_text css=”.vc_custom_1458555050772{margin-top: 10px !important;margin-bottom: 10px !important;}”]Software as a service   Commercial Licensed[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15935″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade” transition_delay=”6″][vc_column_text]

Swirrl

[/vc_column_text][vc_column_text]Swirrl was founded in 2008 specialising in linked open data. Their open data platform PublishMyData is a proprietary platform,although parts are made available as open source drawing on their partnership in the DaPaaS research project which looks to develop more open tools and standards for linked open data. [/vc_column_text][vc_column_text css=”.vc_custom_1458556270886{margin-top: 10px !important;margin-bottom: 10px !important;}”]Software as a service   Commercial Licensed[/vc_column_text][/vc_column][vc_column width=”1/4″][vc_single_image image=”15937″ img_size=”full” alignment=”center” qode_css_animation=”element_from_fade”][vc_column_text]

DKAN

[/vc_column_text][vc_column_text]DKAN or Drupal Knowledge Archive Network is an version of CKAN built as a plugin for open source content management system Drupal. Built and maintained by US based NuCivic. The use of Drupal means that the system can be installed on a hosted server rather than require specialist installation. It’s currently used by one council in the UK,  Cambridgeshire

[/vc_column_text][vc_column_text css=”.vc_custom_1458556241767{margin-top: 10px !important;margin-bottom: 10px !important;}”]Open Source Software as a service[/vc_column_text][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=””][vc_column][vc_text_separator title=”Key” border=”no”][vc_row_inner row_type=”row” type=”full_width” text_align=”left” css_animation=””][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458555332634{margin-top: 10px !important;margin-bottom: 10px !important;}”]Open Source  The platform is available as Open Source software[/vc_column_text][/vc_column_inner][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458554208658{margin-top: 10px !important;margin-bottom: 10px !important;}”]Commercial  The business model is based on the purchase of the software platform.[/vc_column_text][/vc_column_inner][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458554180798{margin-top: 10px !important;margin-bottom: 10px !important;}”]Self-hosted The platform can be hosted on your own servers.[/vc_column_text][/vc_column_inner][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458555195195{margin-top: 10px !important;margin-bottom: 10px !important;}”]Software as a service  The platform is available as a SaaS (software as a service) option from the developers[/vc_column_text][/vc_column_inner][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458554380773{margin-top: 10px !important;margin-bottom: 10px !important;}”]Licensed  The business model is based on licences for the use of the software or parts of it.[/vc_column_text][/vc_column_inner][vc_column_inner width=”1/6″][vc_column_text css=”.vc_custom_1458556216702{margin-top: 10px !important;margin-bottom: 10px !important;}”]

  Parts of the platform are available as open source

[/vc_column_text][/vc_column_inner][/vc_row_inner][/vc_column][/vc_row][vc_row row_type=”row” use_row_as_full_screen_section=”no” type=”full_width” angled_section=”no” text_align=”left” background_image_as_pattern=”without_pattern” css_animation=””][vc_column][/vc_column][/vc_row]