Author: Ebner, S.G.
Paper Title Page
MOPGF059
SwissFEL Beam Synchronous Data Acquisition - A Sneak Peek Under the Hood  
 
  • S.G. Ebner, F. Märki
    PSI, Villigen, Villigen, Switzerland
  • H. Brands, B. Kalantari, L. Sala
    PSI, Villigen PSI, Switzerland
 
  A new Data Acquisition system is being developed for the upcoming FEL at PSI. This system is based on several novel concepts and technologies, and it targets at immediate data availability and online processing. The system is capable of assembling an overall data view of the whole machine thanks to the distributed and scalable buffering back-end. Load on data sources is reduced by immediately streaming data as soon as it becomes available. The streaming technology used provides load balancing and fail-over by design. Data channels from various sources can be efficiently aggregated and combined into new data streams for immediate online monitoring, data analysis and processing. The system is dynamically configurable, various acquisition frequencies can be enabled and data can be kept for a defined time window. All data will be available and accessible enabling advanced pattern detection and correlation during acquisition time. Accessing the data in a code-agnostic way will also be possible through the same REST API that is used by the web-frontend. Furthermore, data can be automatically reduced, compressed and extracted for later studies and documentation.  
poster icon Poster MOPGF059 [0.145 MB]  
 
MOPGF061
PShell: The New PSI Experiment Scripting Environment  
 
  • A. Gobbo
    PSI, Villigen PSI, Switzerland
  • S.G. Ebner
    PSI, Villigen, Villigen, Switzerland
 
  In order to promote competitive advantage for the emerging SwissFEL and existing SLS beamlines, PSI is developing and adopting a modern experiment scripting platform referred to as PShell. This new development, based on the Java platform and Java scripting API, aims to create a tool simple, flexible and accessible. PShell features easy deployment: multi-platform, single-jar installation of a customizable GUI workbench. Experiment logic is expressed in scripts featuring an automatic versioning and publishing system in order to foster collaboration. Many architectural solutions are attainable as the PShell core engine can also be embedded into other applications, or else be executed in client-server or distributed modes. This architectural freedom allows alternative GUI client technologies, but standardizes the experiment logic layer and data file formats (HDF5) across the facilities. PShell enables web and mobile interfaces to beamline services through REST interfaces, encouraging the development of web applications to the final users by providing a customizable application template and component library.  
poster icon Poster MOPGF061 [0.541 MB]  
 
TUA3O02
DA+ Complex Protocols Made Easy for Macromolecular Crystallography Beamlines at the Swiss Light Source  
 
  • E.H. Panepucci, J.A. Wojdyla
    PSI, Villigen PSI, Switzerland
  • S.G. Ebner
    PSI, Villigen, Villigen, Switzerland
 
  Software becomes a key factor for the efficient use of beamtime at synchrotrons and other facilities. Especially for macromolecular crystallography beamlines (MX) data acquisition software starts to make the difference that leads to a competitive advantage. The MX beamlines at the PSI are addressing this issue with the data acquisition software DA+. DA+ is a concept, design and implementation consisting of loosely coupled services and components written in Python and Java. The major components making up the system are the UI, acquisition engine, hardware/detector and online processing. These components are connected via messaging and streaming technologies. The main focus of the software lies on "ease of use", "simplicity", and "immediate feedback". Efficient raster scanning of samples, near real time analysis of the collected raster data and support for standard as well as advanced data acquisition protocols such as multiple anomalous diffraction data acquisition are some examples to name. In this paper the details on these and other features of the software, as well as the underlying concept, will be unveiled.  
slides icon Slides TUA3O02 [3.798 MB]  
 
WED3O06
Data Streaming - Efficient Handling of Large and Small (Detector) Data at the Paul Scherrer Institute  
 
  • S.G. Ebner
    PSI, Villigen, Villigen, Switzerland
  • H.R. Billich, H. Brands, E.H. Panepucci, L. Sala
    PSI, Villigen PSI, Switzerland
 
  For the latest generation of detectors transmission, persistence and reading of data becomes a bottleneck. Following the traditional pattern acquisition-persistence-analysis leads to a massive delay before information on the data is available. This prevents the efficient use of beamtime for users. Also, sometimes, single nodes cannot keep up in receiving and persisting data. PSI is breaking up with the traditional data acquisition paradigm for its detectors and is focusing on data streaming, to address these issues. Data is immediately streamed out directly after acquisition. The resulting stream is either retrieved by a node next to the storage to persist the data, or split up to enable parallel persistence, as well as online processing and monitoring. The concepts, designs, and software involved in the current implementation for the Pilatus, Eiger , PCO Edge and Gigafrost detectors at SLS, as well as what we are going to use for the Jungfrau detector and the whole beam synchronous data acquisition system at SwissFEL, will be shown. It will be shown how load-balancing, scalability, extensibility and immediate feedback are achieved, while reducing overall software complexity.  
slides icon Slides WED3O06 [2.264 MB]