data.govt.nz

23 Posts in 8 Topics

Jump to:

Developing the site

Page: 1 , 2 Go to End Reply
Author Topic: I don't seem to be able to see the bit where I can actually get to the data 913 Views
  • savagehardy
    avatar

    I don't seem to be able to see the bit where I can actually get to the data Link to this post

    This just seems to be a list of some websites that have a spreadsheet or similar

    How do I query the data - is there an open search or similar method i can get stuff

    Are there documented APIs

    or is it just about downloading spreadsheets

    A link like this does not seem to be data
    http://data.govt.nz/dataset/show/633
    just returns a web page even though you say Format : Spreadsheet
    http://www.med.govt.nz/templates/ContentTopicSummary____20511.aspx

    10 clicks later i may find a spreadsheet
    http://www.med.govt.nz/upload/37417/coal_table_1.xls

    should this level of spreadsheet not be catalogued?

    or maybe my idea of data is confused...

  • Anthony Hawkins
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    Hi there. At the moment the records link to a HTML pages, rather than directly to the data. That's usually when those pages contain an index to multiple datasets, or when there's some important caveat included about the data (or any info at all - our summaries for the record summaries are short ). Documenting APIs and other ways into the data are things we're definitely looking at. We're also encouraging depts to provide things like auto-updating xml sitemaps. That kind of discussion is a big part of the project, but in the meantime, we've erred on the side of html.

    Cheers

  • savage hardy
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    I guess there is either a whole of government approach or not

    If this is data.govt.nz surely you should be mandating agencies to do it right. Is thia not how the nz govt standards were done

    However the nz govt standards illustrate how mandating don't really help get a good result - even if some agencies complied there has still been shoddy practice.

    Thinking notably DIA and Commerce both have really bad sytems that create both ugly URIs and keep changing URI stucture without adequate redirection - to trust a URL we need persistence.

    So i dont really care what you are asking agencies/departments - I would rather see what you are saying should happen.

  • Anthony
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    Mandating is not something we can decide, though since launch we've had a number of agencies asking what we'd like and how they can help. Standardising formats and creating solid internal processes about data release (including dealing with URL persistence) is the key. We're beginning to look at this now with other agencies and hopefully non-govt people.

  • Jason Taylor
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    Data formats are also crucial xls is "good step forward" but still requires excel installed to read it properly.

    Promoting XML or any other open standards would be appreciated

    The other issue we have run into are govt sites that have data that you can not get to from a URL but require button clicks.. also not good for data mining

    And requires us to write tedious documents about how to reach the data

  • Anthony
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    Hi there, our definite preference is for open formats. As you say though, its about progress at this stage. Other parts of the public service are looking at standards (or at least coherent guidance) in this area, and that's a priority. We've been concentrating on making the data findable, in the first instance.

    Where we index a non-open format dataset (or HTML dataset), we contact the owner agency and ask it be converted to something better.

    Re linking to referring HTML pages rather than direct to the datasets, we need to let people see the licencing info and sometimes data disclaimer info. Possibly later this could be included in XML feeds or similar, removing the need, but at this stage we need to do this. Cheers

  • Kuraki
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    This site is useless and a waste of tax payer's money. I believe that all of this links can be googled. Did they just do this so that they can do something?

  • Anthony
    avatar

    Re: I don't seem to be able to see the bit where I can actually get to the data Link to this post

    Hi Kuraki. Google's good, but there's a lot of stuff on our site that you'll find only after many results pages' worth of searching. We also check it with agencies where we need to, add metadata, license info etc. It's specialist site, Google's not. You'll be pleased to hear the site was built in-house, with min spending. Cheers

    913 Views
Go to Top Reply