Skip to content

Commit

Permalink
Merge pull request #6 from au-research/gh-pages
Browse files Browse the repository at this point in the history
March 12 Update
  • Loading branch information
edwardshaddow authored Mar 12, 2020
2 parents f3bb372 + bee88b4 commit 2f066ad
Show file tree
Hide file tree
Showing 7 changed files with 74 additions and 113 deletions.
8 changes: 4 additions & 4 deletions _things/thing-08.md
Original file line number Diff line number Diff line change
Expand Up @@ -87,7 +87,7 @@ settings?  Why, or why not?
## Challenge me
### Minting DOIs for research data

The ANDS DOI service (Cite My Data) enables research organisations to
The ARDC DOI service enables research organisations to
assign Digital Object Identifiers (DOIs) to research datasets and
collections as well as well as associated software, workflows, models
and grey literature. The service is intended for use by publicly funded
Expand All @@ -96,7 +96,7 @@ machine-to-machine or manual service.

1. Start by reading an overview of the [ARDC DOI
service](https://ardc.edu.au/services/identifier/doi/ "DOI service")
and perhaps the ANDS DOI service [technical
and perhaps the ARDC DOI service [technical
documentation](https://documentation.ands.org.au/display/DOC/DOI+Service).
2. Consider also the need for guidelines around when a DOI will be
minted, by whom and how DOIs will be managed to ensure long term
Expand All @@ -108,9 +108,9 @@ machine-to-machine or manual service.
and Management
Guide](https://www2.griffith.edu.au/__data/assets/pdf_file/0039/198795/Griffith-University-DOI-guide_1.1-Rev.pdf "Griffith University DOI Guide")

### Want to know more about the ANDS DOI minting service for data, and now grey literature?
### Want to know more about the ARCD DOI minting service for data, and now grey literature?

**Webinar: ANDS expanded DOI service: scope, requirements and FAQs**.
**Webinar: ARDC expanded DOI service: scope, requirements and FAQs**.

Watch the [recording](https://youtu.be/FZPbhHI-a_c "Recording") or go
through the
Expand Down
8 changes: 4 additions & 4 deletions _things/thing-17.md
Original file line number Diff line number Diff line change
Expand Up @@ -84,18 +84,18 @@ if we have such diverse needs.
### DIY to build your own data literacy

Technical data wrangling skills are fast becoming a new form of data
literacy.  The four Carpentry concepts have really taken off over the
literacy. The four Carpentry concepts have really taken off over the
past couple of years.

The “hour a week” for 23 (rd) Things doesn’t allow time to do any of the
The “hour a week” for 23 (research data) Things doesn’t allow time to do any of the
Carpentry modules (most need a couple of hours to complete) but here’s a
chance to find out what all the Carpentry buzz is about.

Have a look at [this Environmental
scan](https://docs.google.com/spreadsheets/d/1ZASH-NhsvXnyZNJkGzFNFp5_adn6Q-iX2N-tbv1Apbw/edit#gid=0)
of courses offering data skills. Then [choose 1 Carpentry to explore in
of courses offering data skills. Then choose 1 Carpentry to explore in
depth or browse over them
all:]
all:

1. [Data Carpentry](http://www.datacarpentry.org)
2. [Library Carpentry](http://librarycarpentry.github.io/about/)
Expand Down
50 changes: 21 additions & 29 deletions _things/thing-19.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@ category: 'Hands on with data & tools'

Apps and APIs are tools which make data much more discoverable and
usable for all of us - not just researchers!  You can choose to explore
both APIs and APPs or just one.
both APIs and Apps or just one.

**Option 1: How are APIs used with data?**

Expand All @@ -28,10 +28,10 @@ to cleverly make data more discoverable and re-usable eg the Google Maps
API is very widely used to record the exact location of a species, or
photograph and lets developers embed Google Maps on webpages.

1\. Start by watching this easy, short (3.24 min) video, ‘[What is an
1. Start by watching this easy, short (3.24 min) video, ‘[What is an
API?](https://www.youtube.com/watch?v=s7wmiS2mSXY)

2\. Metadata records often show at least 2 different APIs in action.
2. Metadata records often show at least 2 different APIs in action.
[Interview material from Western Sydney women's oral history project:
'From farms to freeways: Women's memories of Western
Sydney'](https://researchdata.ands.org.au/interview-material-western-western-sydney/561264/)
Expand All @@ -41,7 +41,7 @@ metadata record shows both:
where the data was collected)
- Views and Accesses API

3\. Trove at the National Library of Australia uses APIs to showcase
3. Trove at the National Library of Australia uses APIs to showcase
National Library of Australia collections in amazing ways. Check out the
[Trove Applications
Galley](http://help.nla.gov.au/trove/building-with-trove/application-gallery "Trove")
Expand All @@ -51,16 +51,12 @@ to see some clever uses of Trove APIs. ****
Galley](http://help.nla.gov.au/trove/building-with-trove/application-gallery "Trove")
to find out what was making news **today** in history?

Click on *Culture Collage* icon ![Trove-Culture
Collage](https://www.ands.org.au/__data/assets/image/0003/574536/trove-culturecollage.png)
>> then click on the *On this day ![Trove On this
day](https://www.ands.org.au/__data/assets/image/0008/574550/trove-on-this-day.png)*
API icon !
- Click on *Culture Collage* then click on the *On this day* API icon !

**Option 2: Apps for researchers and citizen scientists (is that you?)**

Often several little APIs underpin **** a (software) **App(**lication)
(program).  Data gatherers in the field use apps to make data collection
Often several little APIs underpin a (software) App(lication)
(program). Data gatherers in the field use apps to make data collection
easier, more accurate and more rich. eg fill out data forms offline on
their smartphones and tablets, capture images, photos, videos and
sounds, track locations on maps (probably using the Google Map API), and
Expand Down Expand Up @@ -90,32 +86,31 @@ millions of Australian resources including newspaper articles, images
and manuscripts. The Trove API enables people to create new
applications, tools  and  interfaces using the rich store of Trove data.

1\. Start by browsing around the [Trove Application
1. Start by browsing around the [Trove Application
Gallery](http://help.nla.gov.au/trove/building-with-trove/application-gallery)
for some of the creative ways people have used the Trove API. Be
inspired!

2\. To see more of the power of one API, watch this [short
video](https://www.youtube.com/watch?v=GMkGlOYvz8I)[(3:09
min)](http://help.nla.gov.au/trove/building-with-trove/api). The screen
is a bit fuzzy but you can get the idea of this innovative “use your
2. To see more of the power of one API, watch this [short
video](https://www.youtube.com/watch?v=GMkGlOYvz8I)(3:09
min). The screen is a bit fuzzy but you can get the idea of this innovative “use your
voice to query Trove” API.

**Share** your thoughts on how APIs could make data more exciting and
accessible for more people.

**If you have time to get hands on!**

3\. Browse the
3. Browse the
[introduction](http://help.nla.gov.au/trove/building-with-trove) to the
[Trove API](http://help.nla.gov.au/trove/building-with-trove/api).

4\. Go the [Trove API Console](http://troveconsole.herokuapp.com/) and
4. Go the [Trove API Console](http://troveconsole.herokuapp.com/) and
click on some of the example searches provided. The results are in a
machine readable format but look closely and you can see the citation
details eg title, date, source, pagination

4. Try constructing your own API query to see what results you
5. Try constructing your own API query to see what results you
get.  Note that: If you want to use them in your own code you'll need to
get an API key and add '&key=\[Your API key\]' to the url.

Expand All @@ -129,28 +124,25 @@ APIs and Apps are the transformation agents which make data and services
powerful and accessible. These two options give you a chance to see how
APIs can be applied to either data or services.

**Option 1**: **Hands-on API tutorials**\
**Option 1**: **Hands-on API tutorials**
Are you new to APIs and want a hands-on introduction to commonly used
APIs, including Twitter and YouTube? Choose one API from the [Codecademy
APIs](https://www.codecademy.com/apis) and work through the online
tutorial to learn more about the API you chose.
APIs, including Twitter and YouTube? Work through some or all of the [tutorial from freeCodeCamp](https://www.youtube.com/watch?v=GZvSYJDk-us) to get hands on learning about working with APIs.

**Consider:** how the APIs could be applied to a dataset to make it more
reusable?
**Consider:** how the APIs could be applied to a dataset to make it more reusable?

**Option 2: APIs for ANDS Services**\
**Option 2: APIs for ANDS Services**
If your institution uses ANDS services, you might want to use one or
more of these APIs to enhance your services.

Explore one of these APIs to get a feel for what the API does and
whether it may be useful to your organisation:

- [OAI-PMH
Provider](http://developers.ands.org.au/services/collections-registry-api/oai/ "OAI"):
Provider](https://documentation.ands.org.au/display/DOC/OAI-PMH+Provider "OAI"):
use this API if your system is a harvester which is compatible with
the OAI-PMH protocol.
- [Research Activity Grants
API](http://developers.ands.org.au/services/research-activity-api/ "Grants API"):
API](https://documentation.ands.org.au/display/DOC/Research+Activities+API "Grants API"):
provides machine access to research activity information contributed
to Research Data Australia such as grants and projects. A
light-weight method to query the ANDS Registry for specific
Expand All @@ -173,4 +165,4 @@ National organisations:

International organisations:

- [Re3data.org](https://www.re3data.org/search?query=api "Re3data")
- [Re3data.org](https://www.re3data.org/search?query=api "Re3data")
11 changes: 4 additions & 7 deletions _things/thing-20.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ then, for all of us to have an understanding of spatial data.
**Just for fun**: enter your address in the Atlas of Living Australia
and see what birds and plants have been reported [in your street or
suburb](https://biocache.ala.org.au/explore/your-area "ALA: Explore Your Area").
You may be surprised at how ‘alive’ your street is. ****
You may be surprised at how ‘alive’ your street is.

**Consider:** why do you think these geospatial visualisations are so
powerful?
Expand All @@ -54,14 +54,11 @@ a particular location. Let’s look at a couple of examples**.**

1. Go to [Research Data Australia](https://researchdata.ands.org.au/)
and choose **Map Search** from under the search
box.![T20-RDA](https://www.ands.org.au/__data/assets/image/0012/577983/rda.png){width="339"
height="127"}
box.
2. Zoom in on a location in Australia and use the rectangle tool at the
top of the map to draw a search box around your chosen location.
Hint: choosing somewhere on the coast (such as the Newcastle area)
will give you a wider range of datasets.\
![T20-click
image](https://www.ands.org.au/__data/assets/image/0011/577982/click.png)
will give you a wider range of datasets.
3. Then click on the green *Search* button
4. Browse through your results and look at the list of provider
organisations and subject headings for the records in your result
Expand Down Expand Up @@ -134,4 +131,4 @@ customise your map.

**Consider**: the data world is hungry for Geospatial tools and metadata
and there is growing demand for people with these skills. How can these
skills be encouraged in your institution?
skills be encouraged in your institution?
34 changes: 17 additions & 17 deletions _things/thing-21.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,24 +7,23 @@ description: |
Dig in to dirty data.  What is it?  Why should we care? Try your hand at
using an open source data cleansing tool.
overview:
Getting started: Pregnant men? The data says so! Getting down and dirty with data
Learn more: Turn a PDF ‘tabula rasa’ into usable data with Tabula
Challenge me: OpenRefine is a powerful tool for cleaning up lots of  dirty data
Getting started: Data horror stories! Getting down and dirty with data
Learn more: Turn a PDF ‘tabula rasa’ into usable data with Tabula
Challenge me: OpenRefine is a powerful tool for cleaning up lots of  dirty data
---

## Getting started
### Dirty data stories

Data horror stories: how did it happen?

Why is "clean” data important? Public policy, changes to medical
protocols and economic decisions all depend on accurate and complete
data. Thing 21 looks at the why and what of “dirty data.”
data. This thing looks at the why and what of “dirty data.”

1. Pregnant men? Yes! Read some [real data horror
stories](http://www.relevategroup.com/blog/dirty-data-horror-stories-–-when-good-data-goes-bad "When good data goes bad: blog")
about dirty data.
1. Read some [real data horror stories](https://www.arnnet.com.au/article/197085/perils_dirty_data/? "Perils of dirty data: blog") about dirty data.
2. How does data get dirty in the first place? This [short
video](http://aspcapro.org/resource/saving-lives-research-data/gis-video-what-makes-data-dirty "ASAPCA video")
video](https://vimeo.com/95289871 "ASAPCA video")
(5 min) from the ASPCA (American Society for Prevention of Cruelty
to Animals) shows simply how incomplete, inaccurate data can occur.
You can imagine how the resultant problems would multiply
Expand Down Expand Up @@ -70,10 +69,11 @@ data from PDFs, with a focus on introducing Tabula, a free open-source
tool build for this specific task.

1. Get ready: go to [Extracting Data From
PDFs](http://schoolofdata.org/extracting-data-from-pdfs/)
1. Download the correct version of Tabula for your operating
system, and java runtime if required
2. note this tutorial doesn’t work on scanned pdfs
PDFs](http://schoolofdata.org/extracting-data-from-pdfs/) and download the correct version of Tabula for your operating
system, and java runtime if required.

(Note: this tutorial doesn’t work on scanned pdfs)

2. Work through as much of the Tabula tutorial as you can and remember
this tutorial for the next time you get a PDF with valuable (and
hard-to-extract) data.
Expand Down Expand Up @@ -104,7 +104,7 @@ creeping into your
The School of Data have some really interesting [Data
Cleansing](http://schoolofdata.org/courses/#IntroDataCleaning) modules.

**Consider: **strategies for encouraging data to be published in more
**Consider:** strategies for encouraging data to be published in more
re-usable formats rather than PDF.

## Challenge me
Expand All @@ -116,8 +116,8 @@ manipulate data; clean up dirty data; and to transform datasets.

**Option 1: If you are new to OpenRefine**

1. Start by watching[introduction to
OpenRefine](https://youtu.be/B70J_H_zAWM) (6 .48mins) to learn how
1. Start by watching [introduction to
OpenRefine](https://youtu.be/B70J_H_zAWM) (6.48mins) to learn how
it can be used to clean up messy data.
2. Now get hands on!  You will need to download OpenRefine and the
dataset for this activity. Work your way through as much as [this
Expand All @@ -132,10 +132,10 @@ Take a look through the lesson materials used to teach OpenRefine in
either:

1. OpenRefine in [Library
Carpentry](https://github.com/LibraryCarpentry/week-four-library-carpentry/blob/master/lesson-materials/Basic-OpenRefine-functions-I.md)
Carpentry](https://librarycarpentry.org/lc-open-refine/)
2. OpenRefine in [Data Carpentry for
Ecology](http://www.datacarpentry.org/OpenRefine-ecology-lesson/)

**Consider:** Carpentry course Trainers and Helpers are often in high
demand. Would you consider becoming a trainer to teach tools such as
Open Refine?
Open Refine?
20 changes: 5 additions & 15 deletions _things/thing-22.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,7 @@ research alphabet soup) are:

- Universities - 41 universities generate data, graduate and train new
researchers (ANU, UWA, UQ, UTas, UNSW etc)
- CSIRO - have visited the CSIRO Data Access Portal several times in
23(rd) Things
- CSIRO - Australia's national science agency
- Funders - ARC and NHMRC
- Governments - state and federal departments fund research and
produce their own data (e.g. Bureau of Meteorology for weather,
Expand All @@ -49,13 +48,9 @@ Let’s focus on NCRIS - it’s amazing.
NCRIS is designed to take a national approach to providing the world’s
best research infrastructure for Australia. NCRIS facilities provide
storage for data ([RDS](http://www.rds.edu.au/)), research computer
networking across Australia ([AARNet](https://www.aarnet.edu.au/)),
tools and virtual laboratories for researchers
([NeCTAR](https://nectar.org.au/)), very, very big data crunching
networking across Australia ([AARNet](https://www.aarnet.edu.au/)), very, very big data crunching
([NCI](https://nci.org.au/)), as well as lots of specialised research
facilities. ANDS is also one of the 27 NCRIS facilities. In 2018 ANDS,
Nectar and RDS were combined to create the Australian Research Data
Commons ([ARDC](ardc.edu.au "ARDC")).
facilities. This includes the Australian Research Data Commons ([ARDC](ardc.edu.au "ARDC")).

- Browse over some [NCRIS case
studies](http://www.education.gov.au/ncris-case-studies) to get an
Expand Down Expand Up @@ -138,14 +133,9 @@ published.

**Option 1: Virtual Laboratories**

Explore one or more of the Nectar Virtual Laboratories - who uses these
Explore one or more of the [Nectar Virtual Laboratories](https://nectar.org.au/labs-and-tools/) - who uses these
laboratories and what do they do?

- Explore in [words](https://nectar.org.au/labs-and-tools/)
- Explore in
[videos](https://www.youtube.com/playlist?list=PLkBeePYo-_VCwaNDa9q3Y4PtM71PJ7UB6)
- Pick one or two and explore in depth

**Option 2: Australian Urban Research Infrastructure Network (AURIN)**

AURIN is a powerful mapping tool with a wide range of inbuilt datasets.
Expand All @@ -154,4 +144,4 @@ min) to see how it can be used to build national or small maps,
particularly for social science and health.

**Consider:** how researchers can use NCRIS facilities to help generate,
manage, share and publish their data.
manage, share and publish their data.
Loading

0 comments on commit 2f066ad

Please sign in to comment.