Bluemix and BigData at Roskilde Festival

When one of Denmark's smallest cities erupts into one of the largest as part of one of the world's most eminent music festivals, how does the town adapt? IBM, Roskilde Music Festival and The Copenhagen Business School (CBS) came together to gather and understand terabytes of data generated by the event to help make it one of the most efficient, sustainable, and enjoyable festivals in the world.

Ten days of infinite unknowns

The Roskilde Festival is "the perfect microcosm of a complex modern city." It generates immense amounts of data, both structured and unstructured, generated from geospatial, social media and a multitude of other sources. 

Enter the data laboratory

To help gather, process, store, and analyze the Festival's data:

• The IBM Bluemix platform on the SoftLayer infrastructure—a cloud-based analytics environment—provided the backbone.
• dashDB, a managed data warehousing platform, stored the data.
• SPSS, an intuitive visual modeler, cleaned and merged the data.
• SoftLayer’s AutoScale service automatically scaled the data.
• IBM Watson Analytics offered real-time analytics for non-technical users.

A gateway of geospatial data

Festival goers opted-in via more than 60,000 smartphones to share information about their activities in real-time, and the behavior of the crowds was visualized in polygons and color-coded, time-lapsed animations—91 million rows of data was used to create 60 seconds of time-lapse.

Data in motion

Information took shape: The sale of food and average over time, the popularity of the various artists, the usage of bathroom facilities and parking, and so on created a comprehensive view of what was happening at the festival.

Real-time, operational decisions

By making this wealth of data accessible to non-data scientists, the Festival gained insights enabling better operational decisions that will minimize food waste, improve security, and optimize the festival experience.

"For one week each year, a small town called Roskilde on the outskirts of Copenhagen temporarily becomes Denmark’s fourth largest city. The renowned Roskilde Festival attracts 130,000 visitors annually, who camp out and attend more than 170 live music and cultural performances. During the ten-day festival, the crowds buy and consume approximately 200 tons of food and generate 300 tons of waste. There is growing international recognition that mankind needs to make drastic changes to meet the challenges we face around climate change, a point underscored at the 2012 “Rio+20” United Nations conference on sustainable development. Inspired by this conference, researchers at the Copenhagen Business School (CBS) wanted to do more than just talk about sustainability.  "

Source : http://www.ibmbigdatahub.com/infographic/cloud-data-rocks-out-roskilde-festival

Never Win10... Want Linux or Win7

How existing Windows users can refuse Microsoft's Windows 10 update:
http://www.zdnet.com/article/how-existing-windows-users-can-refuse-microsofts-windows-10-update/

"If you don't want Windows 10 to install automatically on your Windows 7/8 PC or tablet, for whatever reason, here's what to remember":

Note!  Grc.com got a tool to turn off Win10:   https://www.grc.com/never10.htm

The irods to FigShare design

The idea : 

Copy files from iRODS to Figshare.

To make it easy for the user(s) this will be done via a Web-GUI,

where there the user will select the file and right click to get a file-menu.

           The code from : https://github.com/sunadtudk/irods_2_figshare
Please note!!  Update the api.py from https://github.com/makkus/pigshare

# please note!  
# please do before playing with figshare: 
# yum update ; yum -y install python-pip
# pip install git+git://github.com/iPlantCollaborativeOpenSource/pycommands.git
# pip install --upgrade pip
# pip install --upgrade git+git://github.com/irods/python-irodsclient.git
# pip install pigshare
#  Do a "pigshare -h"  to see the API ;-)
# irods_2_figshare
# By Sune Andersen
# version 0.1b   
import fileinput
import requests
import os
from irods import *
from irods.session import iRODSSession
from irods.models import Collection, User, DataObject
sess = iRODSSession(host='localhost', port=1247, user='irodsuser', password='XxxxxxxA', zone='MyZone')
coll = sess.collections.get("/MyZone/home/irodsuser")
fileout = open('figshare_test.txt', 'w')
objf = sess.data_objects.get("/MyZone/home/irodsuser/figshare_test.txt")
with objf.open('r+') as f:
   for line in f:
     fileout.write(line)
#   Test : 
#BASH #   pigshare create_article --article '{"title": "irods test", "custom_fields": {"key1": "from_irods"}}'
#{
# "location": "https://api.figshare.com/v2/account/articles/3393214"    <----  This number is the article ID for upload
#}
#BASH #    pigshare upload_new_file --id 3393214 figshare_test.txt

Today kick off : eScience @ DTU - Pictures...

Today kick off : eScience @ DTU.dk - Some pictures

Really? a new login on a Outlook in Polen?

Oh!!.....  I need to update my login on a page in poland... Most be armature night agian...

The mail :

Kære bruger ,

På grund af den igangværende ændring i vores login side , vil du blive brug for at validere din konto login , så vi integrere din konto til den nye login-siden . 

Klik på Single Sign -On linket nedenfor for at validere din konto ved at logge ind :

http://xxxxxx/mail.win.dtu.dk/owa/auth/

BEMÆRK : ENTER dit brugernavn og password , som forkert brugernavn og adgangskode VIL AUTOMATISK deaktivere din konto . Undladelse af at gøre dette vil resultere i permanent begrænset adgang til din postkasse .

Tak fordi du valgte DTU .

Hilsen,

DTU Webmail verifikationstjenester

DTU ITS Help Desk | Copyright © 2016 Danmarks Tekniske Universitet . Alle rettigheder forbeholdes.

The site looks like this:

ImageMagic Bug... Update your iRODS - CVE-2016–3714

There are multiple vulnerabilities in ImageMagick, a package commonly used by web services to process images. One of the vulnerabilities can lead to remote code execution (RCE) if you process user submitted images. The exploit for this vulnerability is being used in the wild.

If you use ImageMagick or an affected library, we recommend you mitigate the known vulnerabilities by doing at least one of these two things (but preferably both!):

• Verify that all image files begin with the expected “magic bytes” corresponding to the image file types you support before sending them to ImageMagick for processing. (see FAQ for more info)
• Use a policy file to disable the vulnerable ImageMagick coders. The global policy for ImageMagick is usually found in “/etc/ImageMagick”. The below policy.xml example will disable the coders EPHEMERAL, URL, MVG, and MSL

Source :  http://www.jupiterbroadcasting.com/99566/getting-inside-the-oryx-pro-las-416/          

Info : https://imagetragick.com/

PoC : https://www.exploit-db.com/exploits/39767/

HD crash on NAS and NASA is using iRODS!!!

Crap!! ... the NAS where 11 TB data is living on crashed on one disk. Lucky we are running Raid 6!!
got a new disk and let it rebuild the Raid pool.

For Real NASA ?? Just got in contact with a guy working at NASA, They use iRODS too!

Proteomics is an area in which the EDRN Informatics Center is investing resources to provide processing pipelines of proteomics datasets. This is an effort in collaboration with Vanderbilt University Medical Center Mass Spectrometry Bioinformaticist David Tabb. Proteomics is a project currently under-development.

Source :
http://cancer.jpl.nasa.gov/documents/applications/laboratory-catalog-and-archive-service-labcas/proteomics