EU-funded tool to help our brain deal with big data

Every single minute, the world generates 1.7 million billion bytes of data, equal to 360,000 DVDs. How can our brain deal with increasingly big and complex datasets? EU researchers are developing an interactive system which not only presents data the way you like it, but also changes the presentation constantly in order to prevent brain overload. The project could enable students to study more efficiently or journalists to cross check sources more quickly. Several museums in Germany, the Netherlands, the UK and the United States have already showed interest in the new technology.

Data is everywhere: it can either be created by people or generated by machines, such as sensors gathering climate information, satellite imagery, digital pictures and videos, purchase transaction records, GPS signals, etc. This information is a real gold mine. But it is also challenging: today’s datasets are so huge and complex to process that they require new ideas, tools and infrastructures.

Researchers within CEEDs (@ceedsproject) are transposing big data into an interactive environment to allow the human mind to generate new ideas more efficiently. They have built what they are calling an eXperience Induction Machine (XIM) that uses virtual reality to enable a user to ‘step inside’ large datasets. This immersive multi-modal environment – located at Pompeu Fabra University in Barcelona – also contains a panoply of sensors which allows the system to present the information in the right way to the user, constantly tailored according to their reactions as they examine the data. These reactions – such as gestures, eye movements or heart rate – are monitored by the system and used to adapt the way in which the data is presented.

Jonathan Freeman,Professor of Psychology at Goldsmiths, University of London and coordinator of CEEDs, explains: “The system acknowledgeswhen participants are getting fatigued or overloaded with information.  And it adapts accordingly. It either simplifies the visualisations so as to reduce the cognitive load, thus keeping the user less stressed and more able to focus.  Or it will guide the person to areas of the data representation that are not as heavy in information.”

Neuroscientists were the first group the CEEDs researchers tried their machine on (BrainX3). It took the typically huge datasets generated in this scientific discipline and animated them with visual and sound displays. By providing subliminal clues, such as flashing arrows, the machine guided the neuroscientists to areas of the data that were potentially more interesting to each person. First pilots have already demonstrated the power of this approach in gaining new insights into the organisation of the brain.

From museums to shops

Possible applications for CEEDs abound, from inspection of satellite imagery and oil prospecting, to astronomy, economics and historical research. “Anywhere where there’s a wealth of data that either requires a lot of time or an incredible effort, there is potential,” adds Professor Freeman. “We are seeing that it’s physically impossible for people to analyse all the data in front of them, simply because of the time it takes. Any system that can speed it up and make it more efficient is of huge value.”

The CEEDs system can help with gathering and reacting to feedback from users in places as shops, museums, libraries and concerts. In the physical and virtual classrooms, professors could teach students more efficiently by adapting their presentations to their attention level. The CEEDs technology has been used for two years at the Bergen-Belsen memorial site in Germany and discussions are ongoing with museums in the Netherlands, the UK and the United States ahead of the 2015’s commemorations of the end of World War II. The project’s team is in discussion with several public, charity and commercial organisations to further customise a range of CEEDs systems to their needs.  Applications discussed are related to a virtual retail store environment in an international airport and the visualisation of soil quality and climate in Africa in order to assist local farmers in optimising crop yields.

Making the most of big data

CEEDs is a large project: 16 partners in nine countries (Finland, France, Germany, Greece, Hungary, Italy, Spain, the Netherlands and the UK) are putting their heads together to optimise human understanding of big data. €6.5 million of EU funding is invested in this innovative initiative, under the Future and Emerging Technologies scheme @fet_eu

EU action to take advantage of big data goes beyond research projects. The European Commission has recently called on national governments to wake-up to the big data revolution (press release) and is using the full range of policy and legal tools make the most of the data-driven economy (more information).

Vice-President of the European Commission @NeelieKroesEU, responsible for the Digital Agenda, says: “Big data doesn’t have to be scary. Projects like this enable us to take control of data and deal with it so we can get down to solving problems. Leaders need to embrace big data.”

Read more about the CEEDs project (also in French, German, Italian, Polish and Spanish).

Useful links

http://www.euronews.com/2014/02/10/beyond-the-subconsciousVideo on Euronews – Futuris programme

(also in French, German, Greek, Hungarian, Italian, Portuguese and Spanish)

Blog post by CEEDs project coordinator Professor Jonathan Freeman – Ethics at the core of the CEEDs project

TEDx lecture by CEEDs scientific coordinator Professor Paul Verschure – From big data to big ideas