We are the content!

Since 1967 the Consumer Electronics Show CES in Las Vegas has been the display for the latest products in electronic entertainment. Every first week in Januar the big brands disclose their secret products, that will be stacked on the shelves – or rather: put on the online shops.

Until recently, CES was the home match for the classic industry: Hifi, TV sets, car radio, … Even with Apple, Microsoft, and their likes have played an increasingly important role, their focus at this trade show was still also „classic“ home entertainment: Smart TV, home cinema, computer games.

TV ist dowdy

Also for 2015 the industry had set-up their things. Companies like Samsung would make clear their strategy in advance: Even more fancy TV sets with even more features. But things turned out quite differently. It seamed as if nobody wanted to watch the TV screens on this year’s CES. Classic home electronics appeared like a relict from the 70s. If not before, it became clear at CES 2015, that TV is no longer the „first screen“.

Three Trends at CES2015

Three trends dominated the visitors‘ interest and the media coverage of this year’s CES:

First: Connected home, in particular smoke detectors, thermostates, and other totally unsuspicous devices, which however gain enormously in their usefulness when connecte via the Internet; it is thus not the „talking refridgerator“ that has been predicted by industry journalists for years, but classic, dry appliences.

Second: Connected car. What the automotive industry has shown at CES was really amazing: Autonomous cars, market ready; convincing systems for accident prevention, and other novelties in driving safety, that we can expect now in new cars.

Third: Wearable tech, electronics that we carry directly with us. Apart from fitness gadgets like wristbands, pedometers, or connected scales, there are in fact hundreds of smart watches with all kinds of applications, from fitness up to caring for the severely ill.

All three trends have one thing in common: The display by which we interact with them is mobile.

Our smartphones are already no longer just the second screen behind the TV set. In the US, the time spent with mobile devices exceeded watching TV. And the awareness that we dedicate to our mobile screens when checking them more than 200 times a day, is far greater.

The Content

The content that works on our mobiles is by no means online, with just less space on the screen. On our smartphones and tablets, we use mainly the direct communication. Social media, especially Facebook and Twitter, and in particular image-sharing platforms like Instagram are still the closest to what used to be „classic“ media. But more and more forms of connected communication draw their users by the millions or even billions, like messaging apps of Whatsapp or Snapchat sort, or totally new forms, like Yo.

What not long ago would have been derogatorily called ‚user generated content‘, UGC, has become simply the content.

The trends at CES show, how this development will further evolve. Next to the content that gets posted consciously and arbitrarily by the users, like texts or images, more and more automatically generated data is added. Every morning there are thousands automatic posts, published by fitness apps like runtustic about the training of their users. Lifetracking cameras like the narrative clip pictorially document without us being active, our daily routine, Jawbone reports our deep sleep phases to all connected friends in our user group. With ‚Bring Your Own Data‘ sharing of very intimate data, gathered by our gadgets, becomes a serious part of our health care: Our self-tracked data support our doctors at helping us.

Social media, that is shared thoughts and pictures, and self-tracking, that is shared data, are two sides of the same coin: The most interesting stories are humans themselves.

Smartphone Data: Our Talk at Strata+Hadoop World Conference in San Jose

From February 18th to 20th, O’Reilly’s Strata+Hadoop World Conference will once again be the most important Big Data event of the year. More than 6,000 visitors are expected at San Jose Convention Center. I’ve been visitor to every Strata from the beginning. Thus I regard it as a special privilege not only to be there and listen, but give talk myself.

Here is the link to our session:
„Smartphone Data: Tell the Story of People’s Lives.“

Come and visit us there!

BYOD – Bring your own Data. Self-Tracking for Medical Practice and Research

„Facebook would never change their advertsing relying on a sample size as small as we do medical research on.“
(David Wilbanks)

People want to learn about themselves and get their lives soundly supported by data. Parents record the height of their children. When we feel ill, we measure our temperature. And many people own a bathroom scales. But without context, data is little meaningful. Thus we try to compare owr measurements with those of other people.

Data that we track just for us alone

Self-tracking has been trending for years. Fitness tracker like Fitbit count our steps, training apps like Runtustic deliver to us analysis and benchmark us with others. Since 2008, a movement has been around that has put self-tracking into its center: The Quantified Self.

Self-tracking has been tending for years. In this picture you see a wristband that already made it into a museum and is now on display in the London Science Museum.
Self-tracking has been tending for years. In this picture you see a wristband that already made it into a museum and is now on display in the London Science Museum.

However it is not just self-optimizer and fitness junkies who measure themselves. Essential drive to self-tracking originated from self-caring chronically ill.

Data for the physician, for family members, and for nursing staff

In the US like in many countries lacking strong public health-care, it becomes increasingly common to bring self-measured data to the physician. With many examinations this saves significant consts and speeds up the treatment. With Quantified Self, many people have been able to get good laboratory analytics about their health for the first time ever. One example is kits for blood analysis that sends the measurement via mobile to the lab and then displays the results. Such kits are e.g. widely in use in India.
Also for family members and nursing staff, self-tracked data of the pations is useful. They draw a realistic picture of our conditions to those who care for us. Even automatic emergency calls based on data measured at site are possible today.

The image at the top is taken from the blog of Sara Riggere, who suffers from Parkinson. Sara tracks her medication and the syptoms of her Parkinson’s desease with her smartphone. Her story is worth reading in any case, and it shows all facettes that make the topic „own data“ so fascinating:
http://www.riggare.se/ and
http://quantifiedself.com


Mood-tracking – a mood diary. People suffering from bipolar disorder try to help themselves by recording their mood and other influences of their lives. By doing so, they are able to counteract, when they approach a depression, and they are able to finetune their medication much better, than it would be possible by the rare visits to their psychiatrist. (Shown here is soundfeelings.com)

Data for research

Self-recorded data for the first time maps people’s actions and condition into an uninterupted image. For research, these data are significantly richer than the snap-shots made by classic clinical research – regarding case numbers as well as by making possible for the first time to include the multivariate influences of all kinds of behavior and environment. Even if only a small fraction of self-trackers is willing to share their data with researchers, it is hardly to imagine the huge value the findings will have for medicine, enabled by this.

Privacy

The difficulty with these data: they are so rich and so personal, that it is always possible to get down on the single individual. Anonymization, e.g. by deleting the user id or the IP adress is not possible. Like fingerprints, the trace we leave in the data can always identify us. This problem cannot be solved by even more privacy regulation. Already today, the mandatory committment to informed consent and to data avoidance impede research with medical data to such extent, it is hardly worthwhile to work with it, at all. The only remedy would be comprehensive legal protection. Every person sharing their data with research has to be sure that no disadvantages will come from their cooperation. Insurance companies and employers must not take advantage from the openness of people. This could be shaped similar to anti-discrimination laws. Today, e.g. insurance companies are not allowed to differenciate their rates by the insurant’s gender.

Algorithm ethics

Another issue lies within the data itself. First, arbitrary, technical differences like hardware defects, compression algorithms, or samling rates make the data hard to match. Second, it is hardly the raw data itself, but rather mathematical abstractions derived from the data, that gets further processed. Fitbit or Jawbone UP don’t store the three-dimensional measurements of the gyroscope, but the steps, calculated from it. However, what would be regarded as a step, and what would be another kind of movement, is an arbitrary decision of the author of the algorithm programmed for this task. Here it is important to open the black boxes of the algorithms. As the EU commission demands Google to open its search algorithms, because they suspect (probably with good reasons) that Google would discriminate against obnoxious content in a clandistine way, we have to demand to see behind the tracking-devices from their makers.
Data is generated by the users. The users have to be heared what is made from it.

There is no privacy in mobile

Our phones register in radio cells to route the calls to the phone network. When we move around, we occasionally leave one cell and enter another. So our movements over leave a trace through the cells we have been passing the course of the day. Yves-Alexandre de Montjoye and his co-authors from MIT explored, how many observations we need, to identify a specific user. Based on actual data provided by telephone companies, they calculated, that just four observations are sufficient to identify 95% of all mobile users. We need just so little evidence because people’s moving patterns are surprisingly unique, just like our fingerprints, these are more or less reliable identifiers.

Location

When we analyze the raw data, that we collect through our mobile sensor framework ‚explore‘ we found several other fingerprint-like traces, that all of us continuously drop by using our smartphones. Obviously we can reproduce de Monjoye’s experiment with much more granular resolution when we use the phone’s own location tracking data instead of the rather coarse grid of the cells. GPS and mobile positioning spot us with high precision.

Wifi

Inside buildings we have the Wifis in reception. Each Wifi has a unique identifier, the BSSID and provides lots of other useful information.

Wifis in reception around my office. When the location of the wifi emitter is known we can use signal strength to locate users within buildings.
Wifis in reception around my office. When the location of the wifi emitter is known we can use signal strength to locate users within buildings.

Even the aribitrary label "SSID" can often be telling: You can immediately see what kind of printer I use.
Even the aribrary lable „SSID“ can often be telling: You can immediately see what kind of printer I use.

Magnetic fields

To provide compass functionality, most smartphones carry a magnetic flux sensor. This probe monitors the surrounding magnetic fields in all three dimensions.

Each location has its very own magnetic signature. Also many things we do leave telling magnetic traces - like driving a car or riding on a train. In this diagram you see my magnetic readings. You can immediately detect when I was home or when I was traveling.
Each location has its very own magnetic signature. Also many things we do leave telling magnetic traces – like driving a car or riding on a train. In this diagram you see my magnetic readings. You can immediately detect when I was home or when I was traveling.

Battery

The way we use the phone has effect on the power consumptions. This can be monitored via the battery charge probe:

The battery drain and charge pattern is very unique and also telling the story of our daily lives.
The battery drain and charge pattern is very unique and also telling the story of our daily lives.

Hardware artifacts

All the sensors in our phones have typical and very unique inaccuracies. In the gyroscope data shown at the top of the page, you see spikes that shoot out from the average pattern quite regularily. Such artifacts caused by small hardware defects are specific to a single phone and can easily be used to re-identify a phone.

No technical security

„We no longer live in a world where technology allows us to separate communications we want to protect from communications we want to exploit. Assume that anything we learn about what the NSA does today is a preview of what cybercriminals are going to do in six months to two years.“
Bruce Schneier, „NSA Hacking of Cell Phone Networks“

As Bruce Schneier points out in his post: there are more than enough hints that we should not regard our phones as private. Not only have we learned how corrosive governmental surveillance has been for a long time, there are lots of commercial offerings to breach the privacy of our communication and also tap into the other, even more telling data.

But what to do? We can’t just opt-out. For most people, not using mobile phones is not an option. And frankly: I don’t want to quit my mobile. So how should we deal with it? Well, for people like me – white, privileged, supported by a legal system providing me civil rights protection, that is more discomfort than a real threat. But for everyone else, people that can not be confident in the system to protect them, the situation is truly grim.

First, we have to show people what the data does tell about them. We have to make people understand what is happening; because most people don’t. I am frequently baffled how naive even data experts often are.

Second, as Bruce Schneier argues, we have to get NSA and other governmental agencies to use their knowledge to protect us, to patch security breaches, rather then exploit these for spying.

Third, it is more important then ever, to work and fight for a just society with very general protection of not only civil but also human rights. Adelante!

Access Smartphone Data With our new API

Datarella now provides an API for our app ‚explore‘, that allows every user to access the data collected and stored by the app.

An Application Programming Interface, in short API, is an interface for accessing software or databases externally. Web-APIs giving us access via the internet, have become the principle condition for most businesses in the web. Whenever we pay something online with our credit card, the shop system accesses our account via the API of the card issuing company. Ebay, Amazon, PayPal -they all provide us with their APIs to automatize their whole functionality to be included in our own website’s services. Most social networks offer APIs, too. Through these we can post automatic messages, analyze data about usage and reach, or control ad campaigns.

The ‚explore‘ app was developed by Datarella to access the smartphones internal sensors (or probes), and to store the data. It is however not just about standard data like location, widely known because of Google Maps. ‚explore‘ reads all movements in three dimensions via the gyroscope, accelleration, magnetic fields in the environment. Mobile network providers and Wifis in reception are also tracked. From these data we can learn many interesting things about ourself, our surroundings and environment, and about our behavior. To set the data in context, the API also gives out data from other users. For the sake of privacy and information self-determination, this is aggregated and averaged over several users, so that identification of a specific person is not possible.

With our API, Datarella commits to open data: We are convinced, that data has to be available for users.

➜ Here is our API’s documentation: explore.datarella.com/data_1.0.html

➜ Here the download-link for ‚explore‘: play.google.com

We are excited to learn, what you will make from the data.

Download the 'explore' app here.
Download the ‚explore‘ app here.

The social relevance of the explore app guides – The Datarella Interview

Today, we speak with Michael Reuter (KMR), Co-founder of Datarella, about the social relevance of the explore app guides.

Q
At Datarella, you offer different programs your users can participate in. Can you elaborate on the meaning behind these programs?

KMR
With our explore app, we provide a useful free tool for smartphone users to optimize their lives. There is a broad range of specific life situations in which the explore programs provide valuable and sustainable benefits. From lifestyle oriented programs as SMILE!, our guide to learn how to smile in 5 days, to specific health programs as our OsteoGuide which supports users suffering from Osteoporosis – we provide a broad range of programs. The most important aspect for Datarella is to always provide real benefits to our users: it’s not about technology, it’s about the social relevance of technology, its immediate impact on the user.

Q
Could you describe one of those programs and its impacts on your users in more detail?

KMR
Sure! Let’s take the OsteoGuide: in countries with populations with median ages of 45 and older, Osteoporosis has become a widespread disease. People suffer from Vitamin D shortage, move less and less during the day and, as a result, their bone structure becomes more fragile. If Osteoporosis is analyzed at an early stage it’s curable in most cases. To cure a patient from Osteoporosis you have to help her to regulate her Vitamin D level and to move more; i.e. to change her behavior: the patient should use the staircase instead of the escalator, or walk or go by bike instead of using the car or a taxi.

A change of human behavior is one of the toughest challenges you can think of. Ask yourself: how easy is it for you to quit smoking, stop taking the extra bar of chocolate, etc. The best method to support people in changing their behaviors is to provide them with instant feedback of their behavior and to give regular counsel in terms of notifications and recommendations. With the explore app and our programs, we cover these aspects perfectly. We accompany our users during a certain period of time and help them to change their behavior to the better, step by step, day by day. In case of the OsteoGuide, we cooperate with Prof. Dr. med. Reiner Bartl of the Bayerisches Osteoporosezentrum, an acknowleged expert in the field of Osteoporosis.

Q
That sounds fascinating: you say that people in need of medical care can get rid of their diseases by using the explore app?

KMR
To be very clear: the explore app cannot fully compensate a medical treatment. And Datarella is not a team of health professionals. We have to join forces with experts like Prof. Bartl to provide our share of a solution for a patient. But, in many cases, medication can only applied successfully if the patient herself contributes to her well-being. And, in most cases, this means that she has to change her behavior. We have string evidence that the explore app programs are perfect tools to achieve this goal.

Q
You mentioned that the explore programs are free. Where is your business model?

KMR
Yes, every smartphone user can download the explore app and apply for any of the explore programs. It’s free to participate on the basic program level which includes, tasks, notifications and recommendations during the complete program. If a user wants more, e.g. if she is looking for a personalized individual coaching, she would have to subscribe to the premium version of the corresponding program. With the premium version she would also get tasks, notifications and recommendations, but on an personalized level, customized to her individual needs. This coaching approach is mostly sought-after by users who must change their behavior in order to achieve a satisfying level of personal well-being. And if behavior change is a must, then you’ll look for the easiest way to reach your goal. The explore app programs fit very well into that requirement since the user will be coached in a soft, but equally demanding and rewarding way.

Q
Thank you very much for these insights!

Data stories: from facts to fiction

The image above is taken from „Marx Engels Werke“ (MEW): Marxism is the most prominent example of what postmodernism calls a ‚Grand Narrative‘. Marx and Engels took all kinds of data, drew their conclusions, and told the one story that made sense from what they found.

Un poème n’est jamais qu’un alphabet en désordre. (Jean Cocteau)

Our time is perhaps the time of an epidemic of things. (Tristan Garcia)

I remember the elderly complaining about „information over saturation“ or even „overload“ when I was a child, in the early 1980. 30 years later, the change of guards comes to my generation. „But once a sponge is at capacity, new information can only replace old information.“ Things like that we read in random articles every day. But what is this information that people are so afraid no longer to get, when the deluge of data has taken over?

What is data? Data is the raw-content of our experience – primary the sensory readings that get conveyed into our minds, secondary the things we measure when we try to make experiences. I don’t want to get too philosophical here, but there are quite a few thinkers who share my discomfort with connecting data with facts directly. The whole postmodernism is about deconstructing false confidence with empirical truths. A century ago, Husserl already warned us, that sciences thus might give us mediated theories rather than direct evidence. Quantitative social science, be it empirical sociology, be it experimental psychology, is in particular prone to the positivist fallacy. While throwing a dice might be correctly abstracted into a series of stochastically independent occurrences of one and the same experiment, this is almost never true for human behavior.

Let us stop taking data as facts. Let us take data as fiction instead. Let us, just for the moment, think of data as the line of a story by which we tell about our experience. There might very well be no such thing like information in the data – just the scaffolding for different narratives, that reduce the randomness and complexity. Take for example how our eyes abstract the shadow in the room’s corners to straight lines that make the edges. In fact there is no such thing as a line; if you get closer and closer to the edge, you see a rather round or uneven surface spanning between one wall and the adjoining next wall. The edge-impression is just our way to reduce our visual sensory input to a meaningful aggregate; a story.

Data as such is mostly incomprehensible. To comprehend, we have to find structure, construct causalities, reduce complexity. Data visualization is fulfilling the same task: Info graphics tell a plausible story from data, make it digestible for our mind.

The link between data and our comprehension of reality from the data is built via metaphors. A metaphor connects different things in a way, we can identify one with the other. If we summarize objects under one category, this category becomes in fact the metaphor. „‚Table‘ is a word with five letters“, as Rudolph Carnap put it. The concept of a ‚table‘ however is the metaphor, the image, the ideal of an arbitrary set of objects. To speak of a ‚table‘ is our way to evoke an image of the concrete object we have in mind in the consciousness of our audience.

There is no law that forces us to see data as necessary, as caused, and effecting. If data would be positive, scientific progress would just be correcting errors of predecessors. But certainly this is not the case. Even what is called ‚hard science‘ changes direction according to the narrative. Quantum physics was not necessary. Heisenberg’s operators are not reality in the sense that there is a factual object that changes one quantum state to the next. It is a meaningful abstraction from a reality that we cannot directly comprehend. In the same way, we may use data from social interaction, behavioral data, or economic data, and try to find a meaningful narrative to share our model of the world with others.

The narrative that we derive from data is of course by no means totally random. Of course not every narrative does fit our data points. But within our measurements, any model that does not contradict the data could be possible, and might – depending on the context – make an appropriate metaphor of our reality.

Since many narratives are possible, and a broad range of parameters can fit with our data, we should be humble when it comes to value judgements. If a decision can be justified from our data depends on the model we choose. We should be clear, that we have a choice, and that with this choice comes responsibility. We should be clear about our ethics, about the policies that guide our setting the models‘ parameters. We should be aware of algorithm ethics.

We should also recognize that our data story is not free from hierarchy. It is very well possible that we impose something onto others with what is just one possible narrative; no story can be told independently from social context.

When we accept data not to be just the facts that have to add to some information, but as the hints of our story, we will be liberated from the preassure of sucking every bit in our brains. We might miss something, but that will hardly be more dramatic than in past times. Our model might not be perfect, but nevertheless, in hearing the data narrative we might catch a glimpse of what is missing. We should just let go our dogma of data as facts.

As big data becomes the ruling paradigm of empirical sciences, I hope we will see lots of inspiring data stories. I hope that data will transcend from facts to fiction. And I want to hear and tell the fairytale where we wake the sleeping beauty in data.

This is the summary of my talk „Data story telling: from facts to fiction“ I gave at the Content Strategy Forum 2014 in Frankfurt:

Cyborgs and Transhumanism

„The most human thing about us is our technology.“
McLuhan

„I don’t feel that I’m using technology, I don’t feel that I’m wearing technology, I feel that I am technology.“ is how Neil Harbison relates himself to the technology, that he built to enhance his senses: Neil has overcome his color blindness with a special head mounted device that translates the color-composition of his field of vision into tunes. He tells, that the multi-frequency sound of certain sights can be so specific, that he could even recognize the faces of people he knew by their „harmonies“.

„La Noosphère atteindra collectivement son point de convergence, — à la « Fin du Monde »“
Teilhard

Technology is part of human nature. We have been cooking food for more than two million years, so our alimentary system is fully adjusted to our technological diet. We have been wearing clothes even longer, so they have replaced the pelt of our ancestors. Tools are extensions of our bodies, concluded McLuhan, elaborating on the thoughts of Pierre Teilhard de Chardin. Our cooking food is an extension of our metabolism, clothing extends our skin, the microscope is the extension of our eye, and – most important – computers are extensions of our brains, and networked through the Internet become extensions of our nervous system.

„You will become like us.“

„The cyborg deliberately incorporates exogenous components extending the self-regulatory control function of the organism in order to adapt it to new environments.“ wrote Manfred Clynes and Nathan Kline when they coined the term in their 1960 Astronautics paper, proposing „Altering man’s bodily functions to meet the requirements of extratertrestrial environments.“

The „cyborgist“ school, thus, could be seen as the heirs of McLuhan, just consequently thinking further on what tools do with us, with our culture, our way to live.

„Individuals now are conceived by chance. Someday, though, they could be ‚composed‘ in accord with considered desires and designs. Furthermore, when we build new brains, these need not start out the way ours do, with so little knowledge about the world. What sorts of things should our mind-children know? How many people should occupy Earth? What sorts of people should they be? How should we share the available space?“
Minsky, Will Robots Inherit the Earth?

But why stop with extending the body? Could it become possible to overcome our human condition completely? This is the main idea of transhumanism. If cyborgists follow McLuhan, tranhumanists take Teilhards side. The Omega point, when technology makes us leave our body (as Teilhard had proposed would happen), is rethought as the Singularity now: exponential growth of knowledge and computing power will soon provide the support to upload our consciousness to the matrix.

„If a reasoning human being loves and values life, they will want to live as long as possible—the desire to be immortal.“
Istvan, The Transhumanist Wager

„The physics of immortality“ as Frank Tippler called it, would not only end all restrictions of the earthly conditions that bodily creatures like humans used to face. It would not only give us immortality, but would give us instant access to all stored knowledge, all available information, and connect us to all other uploaded beings.

„What if a cyber brain could possibly generate its own ghost, create a soul all by itself? And if it did, just what would be the importance of being human then?“
Kusanagi

We do not need to believe in the Utopian promisses of either narratives. Cyborgism and Transhumanism present us with two perspectives, to what end we want to use our technology. Our tools and cultural techniques might have liberated us from many pressing phyiscal stresses. If we use glasses, we can maintain sight even if challenged by ametropia. A wheelchair gives us back our mobility, at least to some extend. But these aids are designed to enhance parts of our body, not to substitute them. How will we value our bodily life? This defines the chasm, not only between the „enhancementists“ and the „transhumanists“, it is the question of technological determinism as such. Is technology a tool to support us, or is it the remedy of our earthly confinement.

„What D.H.S. has done is make it possible to torture a human being to death, and then start again.“
Richard K. Morgan

The idea of leaving our bodies carries a strong dualism: the self in us has to be some „ghost in the shell“, some software, running in our brain. Is this self just an emergent property of neurons firing, like Douglas Hofstadter proposes, so it is truly possible to run a full-scale simulation online -with all the trimmings like emotions, faith, aesthetics? But what about the delicate interactions of hormones, vegetative nervous system, and our mind? Are they expendable?

In any case, when our bodies become replaceable, our physical existence will be devalued. We might become even more careless about the consequences of our actions. While the „enhancmentist“ while using technology in a genuine hedonistic way, might still have a strong responsibility to her children and future generations, the „transhumanist“ will presume that her memories would be sufficient to cover for environmental losses; for her, there is nothing more real then her thoughts, and thus memories would count for experiences.

Solving the many technological problems involved in manned space flight by adapting man to his environment, rather than vice versa, will not only mark a significant step forward in man’s scientific progress, but may well provide a new and larger dimension for man’s spirit as well.
Clynes/Kline

On Saturday, June 21st, the German Cyborgs Association, Cyborgs e.V., host their first Cyborg Barcamp. I am looking forward to this unconference to not only be inspired by the cyborg-things that people will show and tell, but even more, I hope to have conversations about these ethical questions, that would have sounded like pure science fiction just 20 years ago, but came into reach to become most relevant very soon.

The cyborg barcamp will take place in Berlin at Wikimedia Foundation on June 21st. Link to barcamp site
The cyborg barcamp will take place in Berlin at Wikimedia Foundation on June 21st.
Link to barcamp site