Open Data has the potential to improve public transportation, urban planning, education, government procurement, and many other areas. Steven Adler explains what other applications will Open Data bring in the near future and how it could disrupt all of our notions of traditional government and business roles in society. Steve Adler has been a leader in data management and innovation for over 20 years. He invented the fields of Data Governance, Enterprise Privacy Architectures, and Internet Insurance. He serves currently as the Chief Data Officer of the City of Medellin, Colombia, and created The Data Cooking Show in Lima to teach data to Peruvian journalists. He is a member of the US Department of Commerce Data Advisory Council, and founder of the Africa Open Data Group. In 2014, he led an international team to collect and publish Open Data to assist West African nations struggling to fight the Ebola outbreak. In creating "Ebola Open Data Repository" the team invented a new category of Open Data called People Data - data collected and published by people without support from governments, corporations, or other institutions.
Transcripción
0:05
This morning I want to talk to you about people data, not big data and not data about individual
0:14
people and their private lives, but rather data that people can collect and share with
0:23
other people to make a difference in the world.
0:26
But to tell you this story, I need to take you on a journey that I started about a year
0:30
ago when I hosted an event in Washington, D.C. called the Africa Open Data Jam.
0:38
This event was hosted as part of a large conference that the White House put on called the U.S.
0:45
African Leadership Summit, in which they invited 30 or more African heads of state to Washington
0:52
to meet with the president and other dignitaries and talk about how to improve relationships
0:57
between the United States and Africa.
0:58
and one of the issues on the agenda was open government and open data.
1:04
What is open data?
1:05
Open data is when an organization like a government or a corporation
1:14
publishes data on the web, in a database, outside the firewall,
1:20
for anyone to use, download onto their home computer,
1:24
computer, for any purpose, without restriction and without permission.
1:31
This is a really radical idea because for the last 20 years, large organizations and
1:36
small have been publishing information on the internet with copyright licenses that
1:42
told us what we could do with the information when we read it, whether we could use it again,
1:47
whether we could share it again.
1:48
But now, all of a sudden, for the last few years, organizations are no longer publishing
1:53
publishing data with copyrights, they're giving it to us
1:57
in downloadable files that we can use however we want.
2:02
This movement began in 2005
2:06
with a program started by the World Bank
2:09
called the Transparent Aid Initiative .
2:13
The idea behind the Transparent Aid Initiative was that if countries that donated
2:17
money in foreign aid would publish information
2:21
about the money they gave and where it went and if countries that received this
2:27
aid would also publish information about how they spent it, we could improve the
2:32
efficiency of international economic development and reduce corruption.
2:38
Now, turns out we did improve the efficiency of information communication. We didn't
2:44
do that much about corruption. Turns out that corrupt people are really smart and
2:48
And, by the way, they don't publish their activities in open data repositories.
2:55
Nevertheless, this initiative caught the attention of a freshman senator from Illinois
3:01
who in 2006 brought a new bill to the United States Senate
3:06
to create an open government movement in the United States.
3:10
His bill didn't get enough sponsors and it didn't succeed.
3:14
But when Barack Obama was elected president,
3:18
in 2008, he turned to his campaign staff and said I would like my administration to be
3:25
the most open government in American history.
3:28
I would like us to give the American people information that we collect from them about
3:33
what they do that we use by default.
3:38
Without them sending us Freedom of Information Act requests and waiting online to get the
3:44
the data that we've been holding for hundreds of years
3:46
and maybe someday want to give them
3:48
if they ask pretty please nicely.
3:51
And so he, his campaign staff found some technologists
3:55
who set up a database called data.gov.
3:59
Data.gov today has over 160,000 data sets
4:04
across every part of the American government.
4:07
And it has been copied by nations and cities
4:11
these all across the world, in North and South America, in Asia, in Europe, and in Africa.
4:19
And that's actually why I wanted to host an African Open Data Jam as part of this leadership
4:24
summit, to help African countries build more effective open data programs and to harness
4:30
the power of information to transform their economies and the lives of their peoples.
4:36
So, we had about 120 people join us on August 5th, 2014,
4:41
where we had lots of cool lightning talks about different subjects on open data.
4:46
And in the midst of this conference, at 1 o'clock, in the middle of lunch,
4:51
20 of our participants from Sierra Leone had their phones ring.
4:56
All at once. Like, not separated, all at once.
5:01
You know, like an automated message coming from somebody.
5:03
And they received notification from British Airways
5:07
that their flights back to Freetown
5:11
had been cancelled due to Ebola.
5:14
I don't know if you have any direct experience
5:17
with international crises like hurricanes or tornadoes or diseases.
5:22
A lot of us watch that stuff on TV, and it's really abstract.
5:25
And of course it's tragic, but we really can't relate to it personally.
5:28
But at that moment in the room,
5:30
there were 20 people who really didn't expect that Ebola would ever affect them
5:35
personally, but they were directly impacted. They had family in Freetown
5:39
that they weren't gonna see, and some of these people couldn't go home for months
5:42
because of this outbreak. And we all knew in the room that we couldn't just leave
5:47
them hanging, that we had to drop everything and see what we could do with
5:52
the technologies and the data and the ideas and the imagination of the group
5:56
to focus on how we could help West Africa deal with this Ebola crisis.
6:01
Now, at this moment, I didn't know anything about Sierra Leone.
6:05
I wasn't really quite sure where it was on the map.
6:08
I knew it was in West Africa, but exactly where, I wasn't sure.
6:11
I didn't know anything about Ebola, but I knew we had to help.
6:15
And so we began brainstorming, what could we do to help them?
6:19
And we organized a meet-up group, which now has hundreds of people,
6:24
And we began having conversations every week, working with international aid organizations
6:29
on what could we do to help.
6:31
And we had a team from our research lab that immediately put together a proposal to do
6:37
some social sentiment analysis to identify how people were feeling about Ebola in Sierra
6:45
Leone.
6:45
We worked with the government for weeks.
6:47
and the idea was is that during a crisis the government is the authoritative
6:53
voice of information and warning to the public and they use radio and TV to
6:59
communicate these ideas and messages to the public but often they don't fully
7:05
understand how these messages affect the people there's no real feedback loop to
7:12
to the government about how the messages are being read.
7:16
So for example, early in the crisis,
7:18
the president of Sierra Leone told his people
7:21
that Ebola was an enemy of the state.
7:26
Now this is a really horrible thing to tell people
7:30
because you're basically saying,
7:32
if you've got Ebola, we're gonna shoot you.
7:34
So don't come telling us you've got Ebola
7:36
because we don't wanna hear it.
7:39
and so we set up call centers and told the government that if they're going to give
7:43
messages to the public to let the let the public tell them what they feel about those messages and
7:50
what they think about ebola and what their concerns are and what their what information
7:54
they need we set up this call center to take messages from the public in seven different
7:59
languages we transcribed it into english text we sent the text to a computer a big data analytics
8:05
computer in Nairobi, where we analyzed the messages for social sentiment, for
8:10
emotions. We put that into a heat map to tell the government how their messages
8:16
were affecting the population and how they should change their messages to be
8:19
more effective. And it really was a great solution. Unfortunately, it didn't go into
8:25
Sierra Leone until late October, and we weren't really convinced that that was
8:30
going to be enough to help stem the tide of the outbreak. So we began working on
8:35
other solutions. And one of my colleagues said, what about using open data to collect information
8:41
about Ebola and share it with everybody who's working on the disease? And so we asked people
8:48
who are working on international aid, hey, would you mind if we set up a repository to do that,
8:53
to collect information from the United Nations, from WHO, from universities, from all over the
8:58
world and put it into one repository where everybody could share it? And people said,
9:02
said, that's a great idea. Please go do that. So we organized an Ebola open data jam in New York City
9:09
on October 18th, where we brought together about 120 volunteers who gave a Saturday to work
9:16
together to scour the internet to identify all available public sources of information about
9:21
Ebola and put it in one place. But we ran into one problem. Our lawyers told us that the data
9:29
we might collect could have copyrights and we could inadvertently violate
9:34
copyright and be sued and so they told us that we could not host this data on a
9:41
government or corporate website now we had already announced the event and we
9:46
didn't want to cancel it so we thought what could we do so we decided to set up
9:50
our own open data repository we registered a domain name called Ebola
9:55
boladata.org, and we set up our own open data database, unaffiliated with any government or
10:01
corporation. And in doing so, we invented a new category of data, people data, because we were
10:09
just volunteers, just ordinary people working together to try to make a difference in the world
10:14
by collecting information that other people lacked, and by giving it to them could make a
10:20
difference in what they knew about the world and how they could change it.
10:23
As we collected this information, we began to realize that there was a lot of data that
10:29
we wanted that was missing.
10:31
Really important data.
10:32
Data about the healthcare capacity of the countries that were affected by Ebola and
10:38
what they were doing to deal with it.
10:41
You know, we saw lots of videos on TV about patients who were driving around desperate
10:46
to find beds in hospitals that could treat them.
10:48
Their family would drive them around the countryside looking for empty beds and no one had any
10:53
empty beds to treat these people.
10:55
And furthermore, the hospitals didn't have any communication systems to tell them, oh,
11:00
we don't have a bed, maybe you can find it someplace else.
11:03
So we asked the governments, you know, are there any databases that list all the hospitals
11:09
in your country?
11:11
They didn't have it or it took weeks to produce.
11:13
We eventually found lists of all the health care facilities in all the countries,
11:18
but these lists were generated by eight organizations,
11:21
World Bank, WHO, United Nations,
11:24
and they had inconsistent information.
11:26
Nothing was accurate. It was all out of date.
11:28
And furthermore, the data didn't have anything really meaningful in it.
11:32
It couldn't tell you the GPS coordinates of the hospital.
11:35
It didn't tell you how old the hospital was,
11:37
how many doctors and nurses, what their qualifications were,
11:41
if they had any equipment, and if the equipment worked.
11:43
because a lot of medical equipment in developing countries don't work.
11:48
We wanted to know if the hospital had electricity,
11:51
if it had internet connections and cell phone communication.
11:54
We wanted to know the basic capacity of these hospitals
11:57
to deal with a critical crisis, and it was missing.
12:01
And realizing that it was missing,
12:03
we realized that all the aid organizations who were rushing to give aid
12:06
didn't know what problems they were fixing.
12:09
And this was really apparent in Liberia.
12:13
You know, when the crisis began,
12:15
the president of Liberia, Sir Leif Johnson,
12:18
came to the United States and begged the Obama administration to send aid.
12:22
And of course, we Americans, we like to send aid.
12:25
And we send aid in a specific way.
12:27
We send Marines.
12:28
We send a few thousand Marines to Monrovia,
12:31
not to take over the country,
12:35
just to build Ebola treatment units,
12:37
which are these sort of plastic enclosed beds
12:39
that isolate a patient from other patients
12:41
while they can get liquids to recover.
12:44
We built 3,000 Ebola treatment units in Monrovia
12:49
over the course of six to eight months.
12:52
Do you know how many patients we treated after we built these units?
12:58
28.
13:01
It was several billion dollars that we spent
13:03
sending the Marines over there to build these units.
13:06
And the reason we only were able to treat 28 patients
13:09
was that by the time they got deployed
13:11
and the material got sent over
13:13
and they built the units, the Liberian government had contained the virus with
13:19
the existing health infrastructure they had and the governance that they
13:23
improved by responding to the crisis. And we didn't know that because we didn't
13:29
have any information about the capacity they had or any updates on how they
13:33
improved their governance. And that's a really important lesson in a crisis. If
13:37
you don't know what's working, it's hard to know what to fix. And so we organized
13:42
We organized another Ebola open data jam,
13:44
this time in four locations around the world,
13:47
in New York, in Washington, D.C., in London, and in Kampala.
13:51
We had over 800 volunteers working together
13:53
to identify, first, building a data model
13:56
to help document the capacity of healthcare in these countries,
14:01
and secondly, to collect data from people who lived there
14:05
and from people who lived abroad,
14:07
who were residents of the state, part of the diaspora community,
14:10
to document the information that they had in their heads
14:14
from their own experiences about the hospitals they knew
14:16
in the areas that they grew up in.
14:19
That is, we were collecting people data
14:22
about the world in which these people lived
14:25
to share with the rest of the world to improve things.
14:28
And eventually, we identified hundreds of healthcare facilities
14:31
that were not on the map from any other area.
14:35
And you know, that's really a shame, because today,
14:37
Today, all of us use maps to find this location,
14:42
to figure out where the best coffee shops are,
14:45
gas stations, to go on vacation, to plan trips.
14:50
But we don't have maps that show us
14:52
where critical infrastructure is in our societies.
14:56
We can't find really high-quality information
14:59
about the best schools, about hospitals,
15:02
about social services that work and what they cost
15:05
and the outcomes they deliver.
15:06
And this, to me, is the most important information of all because it's what helps us lead meaningful and productive lives.
15:15
And that's something that we worked on with this open data, this Ebola open data jam.
15:22
And it's why I say to people, you know, you hear vendors often say that we're drowning in data and we have too much of it.
15:30
I tell people that's not true.
15:33
We don't have nearly enough data about the things that really matter in this world.
15:38
And as we move forward, we have to collect a lot more information
15:42
about our world and our communities.
15:46
And the best way to do that is not to wait for government to collect it
15:49
and give it to you when they're ready.
15:51
The best way to collect information is for you to do it yourselves.
15:55
And you can do it yourselves.
15:57
Look, a year ago, I didn't know anything about African open data, about Sierra Leone or Ebola.
16:10
I was just a guy who discovered he could make a difference with data.
16:15
I saw some people in front of me who were personally affected by a crisis, and I felt
16:20
I had to act.
16:22
I'm not a politician.
16:24
I'm not a scientist.
16:25
scientist, I'm not a doctor. But I discovered I could make a difference. And that means
16:31
that all of you can do the same. Today with cloud computing, it's cheap and easy to build
16:37
open databases for people data. And any of you in the audience can do what I did. And
16:43
I urge you all to please take advantage of people data to empower yourselves and your
16:49
communities to make a difference in the world. Thank you.
Transcripción automática. Puede equivocarse, sobre todo con nombres propios.