Sept 30, 2020
Nicolas Weber & Erich Focht
NEC Laboratories Europe, NEC HPC Europe
Effective Neural Networks *Without* GPU | SOL: Transparent Neural Network Acceleration on NEC SX-Aurora TSUBASA
June 18, 2020
Founder & CEO, Wolfram Research
Emerging Surprises in Applying the Computational Paradigm (and the Deep Relations between Physics, Distributed Computing and AI)
Ivo F. Sbalzarini
Chair of Scientific Computing for Systems Biology, Faculty of Computer Science, TU Dresden;
MOSAIC Group, Center for Systems Biology Dresden;
Max Planck Institute of Molecular Cell Biology and Genetics, Dresden
Title: Computational Developmental Biology
Abstract: Our vision is to develop a computer simulation of a developing embryo, incorporating the known biochemistry and biophysics into a computational model in 3D-space and time, which predicts the emerging shape and function of the tissue. Development and morphogenesis of tissues, organs, and embryos emerges from the collective self-organization of cells that communicate though chemical and mechanical signals. Decisions about growth, division, and migration are taken locally by each cell based on the collective information. In this sense, a developing tissue is akin to a massively parallel computer system, where each cell computes robust local decisions, integrating communication with other cells. Mechanistically understanding and reprogramming this system is a grand challenge. While the “hardware” (proteins, lipids, etc.) and the “source code” (genome) are increasingly known, we known virtually nothing about the algorithms that this code implements on this hardware. Using examples from our work, I highlight computational challenges along the way. These range from content-adaptive data representations for machine learning, to novel languages for parallel high-performance computing, to virtual reality and real-time visualization for 3D microscopy and numerical simulations of nonlinear and non-equilibrium mechanical models. This cooperative interdisciplinary effort contributes to all involved disciplines.
Research Fellow & STA STEM Ambassador | ARC Centre of Excellence for All Sky Astrophysics in 3D | School of Physics Senior Research Data Specialist | Melbourne Data Analytics Platform & Petascale Campus Initiative | The University of Melbourne, Australia
Title: HPC Simulations of the early Universe
Abstract: Understanding the formation and evolution of the first galaxies in the Universe is a vital piece of the puzzle in understanding how all galaxies, including our own Milky Way, came to be. It is also a key aim of major forthcoming international facilities such as the Square Kilometre Array and James Webb Space Telescope. In order to maximise what we can learn from observations made by these facilities, we need to be able to accurately simulate the early Universe and model how galaxies affected and interacted with their environments.
Dr Simon Mutch a Postdoctoral Research Fellow in the Australian Research Council Centre of Excellence for All-Sky Astrophysics in 3-Dimensions (ASTRO 3D) and a Research Data Specialist in the Melbourne Data Analytics Platform (MDAP) based at the University of Melbourne. Dr Mutch received a Masters degree in Physics from the University of Edinburgh and was awarded his PhD in astrophysics from Swinburne University of Technology, Australia in 2013. His astronomy research is focused on the first galaxies and their impact on the evolution of the Universe, which he studies using a combination of supercomputer simulations and theoretical modelling. Through his role with MDAP, he is also currently collaborating with academics in areas such as climate science and ecology, to help uplift their digital research capabilities. Dr Mutch contributes to the Australian astronomical community through a number of national committees and is an inaugural Science and Technology Australia STEM Ambassador, a position which sees him meet with policy and decision makers to advocate for the importance of STEM and related fields.
Massachusetts Institute of Technology
Title: High Performance Computing: The Power of Language
Abstract: Julia is now being used for high performance computing for the important problems of today including climate change and Covid-19. We describe how language is making all the difference.
Alan Edelman is a professor of applied mathematics at MIT, is a member of MIT’s Computer Science & AI Laboratory, and is the leader of the JuliaLab and Applied Computing Group at MIT. He is also a cofounder of Julia Computing Inc. He works on numerical linear algebra, random matrix theory and parallel computing. He is a fellow of SIAM, IEEE, and the American Mathematial Society. He has won numerous prizes for his research, most recently the Fernbach Prize from IEEE for innovation in high performance computing.
Founder & CEO, Wolfram Research
Title: Emerging Surprises in Applying the Computational Paradigm (and the Deep Relations between Physics, Distributed Computing and AI)
Stephen Wolfram is the creator of Mathematica, Wolfram|Alpha and the Wolfram Language; the author of A New Kind of Science and other books; the originator of the Wolfram Physics Project; and the founder and CEO of Wolfram Research.
Digital Museology, Digital Humanities Institute | Lead: Laboratory for Experimental Museology (eM+) | Director: ArtLab | EPFL Lausanne Switzerland
Title: Cultural data sculpting
Abstract: In 1889 the curator G. B. Goode of the Smithsonian Institute delivered an anticipatory lecture entitled ‘The Future of the Museum’ in which he said this future museum would stand side by side with the library and the laboratory.’ Convergence in collecting organisations propelled by the liquidity of digital data now sees them reconciled as information providers in a networked world. The media theorist Lev Manovich described this world-order as “database logic,” whereby users transform the physical assets of cultural organisations into digital assets to be—uploaded, downloaded, visualized, shared, users who treat institutions not as storehouses of physical objects, but rather as datasets to be manipulated. This presentation explores how such a mechanistic description can replaced by ways in which computation has become ‘experiential, spatial and materialized; embedded and embodied’. It was at the birth of the Information Age in the 1950s that the prominent designer Gyorgy Kepes of MIT said “information abundance” should be a “landscapes of the senses” that organizes both perception and practice. “This ‘felt order’ he said should be “a source of beauty, data transformed from its measured quantities and recreated as sensed forms exhibiting properties of harmony, rhythm and proportion.”
Archives call for the creation of new prosthetic architectures for the production and sharing of archival resources. At the intersection of immersive visualisation technologies, visual analytics, aesthetics and cultural (big) data, this presentation explores diverse digital cultural heritage experiences of diverse archives from scientific, artistic and humanistic perspectives. Exploiting a series of experimental and embodied platforms, the discussion argues for a reformulation of engagement with digital archives at the intersection of the tangible and intangible and as a convergence across domains. The performative interfaces and repertoires described demonstrate opportunities to reformulate narrative in a digital context and they ways they support personal affective engagement with cultural memory.
Professor Sarah Kenderdine researches at the forefront of interactive and immersive experiences for galleries, libraries, archives and museums. In widely exhibited installation works, she has amalgamated cultural heritage with new media art practice, especially in the realms of interactive cinema, augmented reality and embodied narrative. In 2017, Sarah was appointed Professor of Digital Museology at the École polytechnique fédérale de Lausanne (EPFL), Switzerland where she has built a new laboratory for experimental museology (eM+), exploring the convergence of aesthetic practice, visual analytics and cultural data. She is also director and lead curator of EPFL’s new art/science initiative ArtLab.
Interdisciplinary Centre for Mathematical and Computational Modelling, University of Warsaw | Samsung R&D, Poland
Title: Predicting the course of the COVID-19 epidemic in Poland
Abstract: One of the most promising approaches to predicting the possible scenarios of the epidemic is based on agent-based models. The idea of that model family is quite simple: reproduce the demographic and sociological structure of the society, and run the simulations of the disease spread throughout that structure. The direct reproduction of the contact structure allows investigating the consequences of various administrative measures applied, like school closure or travel restrictions. The model results can be visualised as a dynamic map of spreading disease, and enables the assessment of burden of disease factors locally. Our model, constructed more than 10 years ago for influenza epidemics, has been reanimated and tuned to COVID-19 parameters. It is now producing both scientific results as well as pragmatic reports, which are then being passed to Polish governmental authorities.
Affiliated Researcher at ICM University of Warsaw. Principal Data Scientist at the AI institute, Samsung R&D, Poland. Almost 10 years ago, when working at ICM UW as researcher, he led a project to construct a large-scale agent-based epidemic spread model for influenza disease.
Recently, during the times of COVID-19 pandemic, he became the project leader of development and adaptation of the ICM Epidemic Model to the coronavirus disease. His interests also cover cognitive science, neuroscience and computational biology.
Interdisciplinary Centre for Mathematical and Computational Modelling, University of Warsaw | Espace-DEV, IRD – Institut de Recherche pour le Développement, Montpellier, France
Title: The promises of the One Health concept in the age of anthropocene
Abstract: In May 2019 an article was published: “Anthropocene now: influential panel votes to recognise Earth’s new epoch”, situating et the stratigraphy of Earth’s history a new geological epoch – the domination of human influence on shaping the Earth’s environment. When humansnas are a central figure in an ecological niche its results massive subordination and transformation of the environment for their needs.
Unfortunately, the consequence is robbery of natural resources.
The consequences are socially unexpected – a global epidemiological crisis. The current covid-19 pandemic is an excellent example. It seems that one of the most important questions of the anthropocene era is how to maintain stable epidemiological conditions for now and in the future. The One Health concept proposes a nwe paradigm – a deep look at the sources of our well-being: our relationship with the environment. Our health status is interdependent with the well-being of the environment. It is clear that the socio-ecological niche disturbance results in the spread of pathogens. Can sustainable development of socio-ecological niches help us? Let’s take a look at the results!
Aneta Afelt, PhD, is a geographer working in the area of health geography. Her interest in research is the One Health concept, where environment, epidemiology and epizootiology are considered as interconnected processes located in social-ecological niches. She shows in the research results that the destruction of ecosystems results in epidemiological consequences. She works at the Interdisciplinary Center for Mathematical and Computational Modeling of the University of Warsaw, Poland, and is currently a Guest Researcher at Espace-DEV, IRD – Institut de Recherche pour le Développement, Montpellier, France. She is also a member of the scientific committee for Covid-19 of the Ministry of Science in Poland and a scientific consultant of the European Research Agency for actions dedicated to Covid-19.
Genetic diversity of coronaviruses in bats in Lao PDR and Cambodia. [Infection Genetics and Evolution, 48 (2017) 10–18]
Incidence of dengue and chikungunya viruses in mosquitoes and human patients in border provinces of Vietnam [BioMed Central, Springer Nature, 9 November 2017]
Japanese encephalitis in Indonesia: An update on epidemiology and transmission ecology [Acta Tropica, 187(2018), 240-247]
Distribution of bat-borne viruses and environment patterns [Infection Genetics and Evolution 58(2018), 181-191]
Bats, Coronaviruses, and Deforestation: Toward the Emergence of Novel Infectious Diseases? [Frontiers in Microbiology (11 April 2018)]
Bats, Bat-Borne Viruses, and Environmental Changes [in: Bats, IntechOpen (July 4th 2018)]
Dr. Nicolas Weber, Senior Researcher, NEC Laboratories Europe
Dr. Erich Focht, Senior Manager R&D, NEC HPC Europe
Workshop title: EFFECTIVE NEURAL NETWORKS *WITHOUT* GPU
SOL: Transparent Neural Network Acceleration on NEC SX-Aurora TSUBASA
Date: Wed, Sept 30, 2020
Time: 09.00 am to 12.30 pm CEST
Limited access: 15 participants – first come first served
Payment: Free of charge
Note! Registration deadline, Sept 27, 2020
Participants will be informed about their qualification for the workshop by September 28th.
In 2019, ICM University of Warsaw expanded its HPC infrastructure with a specialized vector computer, NEC SX Aurora TSUBASA , with eight vector processors. Aurora TSUBASA is used at ICM UW for calculations in physics, chemistry, AI, as well as development work intended to adapt and optimize the existing software to work on the new computer architecture.
Distinctive features of NEC SX-Aurora TSUBASA are:
- High memory bandwidth (48 GB, HBM2) of the Vector Engine (>1 TB/s) at < 300 W,
- 64 fully functional vector registers and 192 double precision FP operations per cycle,
- Works within the GNU/Linux environment – natively or in the accelerator mode.
The Workshop is intended as an introduction to two software frameworks designed specifically for NEC SX-Aurora TSUBASA
- NEC SOL – Transparent Neural Network Acceleration  – an AI acceleration middleware enabling wide range of optimizations for neural network workloads. It integrates with existing Machine Learning frameworks such as PyTorch and TensorFlow. SOL offers broad support for hardware architectures including CPUs (x86, arm64), GPUs (NVIDIA), and NEC SX-Aurora TSUBASA. It does not require modification of the original source code allowing the user to focus on solving the problem rather than on the specifics of the hardware architecture;
- Frovedis – FRamework Of VEctorized and DIStributed data analytics  – data analytics software primarily targeting the NEC SX-Aurora TSUBASA architecture.
- SOL: Transparent Neural Network Acceleration:
- Integration with PyTorch;
- Integration with ONNX;
- Frovedis: FRamework Of VEctorized and DIStributed data analytics.
- Hands-on session: SOL at ICM infrastructure.
About SX-Aurora TSUBASA
NEC SX-Aurora Tsubasa, introduced to the market in 2018, is a vector processor (Vector Engine, VE) belonging to the SX architecture line which has been developed by NEC Corporation since mid-1980s . Unlike its stand-alone predecessors, Tsubasa has been designed as a PCIe attached card working within and being operated by an x86_64 host server (Vector Host, VH) running a distribution of the GNU/Linux operating system. The latter provides a complete software development environment for the connected VEs and runs Vector Engine Operating System (VEOS) which, in turn, serves as operating system to the VE programs. .
Nicolas Weber is Senior Researcher at the NEC Laboratories Europe. He received his PhD for work on automated memory access optimizations for GPU in 2017 from TU Darmstadt. Since then he focusses on the efficient mapping of artificial intelligence workloads onto various accelerator processors such as NEC SX-Aurora or GPUs, to transparently increase performance and efficiency.
Erich Focht is Senior Manager of the Research and Development group at NEC HPC Europe. His work topics cover distributed systems software, parallel file systems, hybrid programming models, system software, tools and compilers for vector systems with the focus currently on applications, linear algebra, AI and cooperations on the SX-Aurora vector engine.