PSNC has been researching 4K since 2008, including software like streaming, codecs, and visualization as well as hardware like live 4K. They cooperate with universities, film schools, and artists. Their 4K 3D node includes a professional 3D rig, post-production software, 4K streaming, and a 4K LCD monitor. PSNC is developing new technologies like a 132MP wall, GPU cluster, and 4K/4K3D post-production. They are working on playback, streaming, and a live interface for the RED One camera.

2. 4K Research in PSNC
Cinegrid International Workshop, 7 Dec 2011
Maciej Głowiak – mac@man.poznan.pl
A.Binczewski, M.Strozyk, B.Idzikowski, P.Ostapowicz

3. 4K Node in Poznań
PSNC - Poznan Supercomputing and Networking Center
• Timeline
– 4K node started in 2008
– 3D installation in 2010
• Research
– Software
• Streaming
• Codecs
• Visualization
– Hardware
• Live 4K
• Cooperation
– Universities and Research Institutes
– Film schools
– Artists

4. Stereoscopic
4K 3D Node - PSNC Stereoscopic HD TV
LG 47LD950
projection system
2x SONY SRX-T105
4K projectors
Content storage (48TB) HDMI
and distribution center Video converter
3x SUN Fire x4540 BlackMagic HDLink3D
Two synchronized
4K Content Stereoscopic HD-SDI
(R3D)
Cinematografic
Camera HD/4K HD/4K
RED One 4K Content Streaming Two synchronized
Post-production station
(TIFF, J2K, (JPEG2000 Stereoscopic 4K
Mac Pro with Final Cut Pro
MXF, DCP or JPEG) 8xHD-SDI
and Adobe Production Analog
etc.)
supported by Neo3D or digital
8ch
Sound
Graphics AES
10GbE PIONIER workstation EBU
4K Live extension system For software real-time
Optical network
For RED One camera JPEG decoding
(Frame grabber)
RED Rocket accelerated Sound mixing system
Tascam DM-3200
HD/4K +AES/EBU active
Content JBL loudspeakers
Professional 3D rig
For 2x RED One 4K cameras
JPEG2000 4K Decoder
intoPIX SYX-JP4K
with 2x Pristine4
HD/4K
Streaming D-Cinema
To or from Packages
Other Nodes (MXF/DCP)
JPEG2000 4K Encoder 8xHD-SDI
HD live cameras HPDMNet
Streaming Server
With HDSDI 1080 output
intoPIX SYX-JP4K CineGrid
SONY PMW EX3 and
Panasonic AG-3DA1 GLIF
4K Player
GEANT HD stereo Player
… 4K LCD 56” monitor
Content storage and retrieving (TIFF, J2K, MXF, DCP, etc.) Doremi DSV-J2
Astro DM-3400
+ digital sound
HD/4K live 2D or 3D streaming

5. New deployments 2011
• 132MPix wall (15K x 8.6K)
– 64 Full HD LCDs
– 2 PC with ATI cards
– For presentation scientific visualization
• Molecular structures
(bio- and nanotechnology)
• Geografical data
– SAGE, Vitrall, etc.
GPU accelerated cluster (in progress)
160TFlops in total,
about 220 nodes
2x AMD 12-core per node
nVidia Tesla M2070 acceleration
Infiniband QDR FatTree
Applications: radioastronomy, physics, visualizations

6. 4K & 4K3D post-production
– HD, 4K and 4K 3D
– 1 man dedicated to 4K & 3D
– PLATON HDTV Team cooperation
– Adobe Premiere
• Native RED (R3D) file support
– Cineform Neo3D
(plugin for Adobe Premiere Pro):
• Useful tools for 3D picture corrections
• Stereo encoded files
• Simple switching between presentation
formats (side-by-side, upper-
lower, separate eyes and many more)
• Working in real time
• Support for hardware preview

7. Playback and streaming
• Started from DOREMI DSV-J2 + MB4K
– 4K and HD3D
– No support for 4K 3D (RGB 444)
– DCP creation quite complex
– Not sufficient
Flow Free Commercial Hardware
software software
OpenJPEG Kakadu (SDK) – >500$ intoPIX PRISTINE4
Kakadu CineAsset (Pro) - $4.000 Barco DCPB2000
TIFF J2K ImageMagic/GraphicsMagick Easy DCP - €3.000 OpenCube DCP (€20.000)
CUJ2K OpenCube - €1.000 Doremi DMS-2000 (€90.000)
… NTT J2K 4K codec
J2K ASDCPLib
MXF Free MXF
WAV
Easy DCP (trial) Mastering station:
CineAsset - $4.000 OpenCube DCP (€20.000)
Easy DCP - €3.000 Doremi DMS-2000 (€90.000)
Open Cinema Tools OpenCube - €1.000 Clipster DVS
MXF DCP Easy DCP (trial) or more…

8. 4K 3D streaming client-server
and player development
– One modular application for three purposes:
• Inexpensive solution (e.g for research and experiments)
– Open source
– JPEG software decompression
– Cheap equipment (PC + software/GPU codec)
• Professional solution (e.g. for digital cinemas)
– DCI compliant
– JPEG2000 hardware acceleration (Pristine4)
– Cooperation with hardware vendor (intoPIX)
• 4K (3D) live streaming
– Use of Future Internet networks
(IPv6, dedicated multimedia data stream switching)
JPEG
Streaming Streaming
Server RTP Client
HD/4K JPEG
2D/3D 2000

9. Streaming Server
• Streaming Server
– Streaming stereo 4K + audio
– Various video codecs (intra-frame)
• JPEG
• JPEG2000
• Use of other containers (such as MXF/DCP)
– Testing behaviour of codecs depending on compression rate and
network parameters
– Transport: single stream RTP/RTSP up to 1 Gbit/s
– IPv6 enabled
– Experimental Data Stream Switching network
– Open source, Linux
– Testing various streaming libraries (gstreamer, live555, own
implementation, etc.)

10. „Low cost” playback and streaming
fps
JPEG software decompression (4K 3D) c
• Implementation
Thrds
– Multithread C++ application (DirectX 10), no GPU acceleration.
– Integration of libturbo-jpeg for software JPEG decompression
– JPEG decompression for ~50 fps in 4K (Intel Core i7 960)
– 4K 3D (2x 24fps in 4096x2160)
– Up to 1Gbit/s for 70-90 compression ratio
– 2 x ATI FirePro v8800 each for displaying 2 x 4K (passive 3D)
Streaming client and JPEG player for 4K 3D
Multithreaded
JPEG decoder
Pre-encoded libturbo-jpeg (4K video)
4x DVI
Decompressed
JPEG files
Compressed
Data queue
FireGL v8800
Data queue
render
Frame
libturbo-jpeg
RTP network … FireGL v8800
Streaming of (4K video)
JPEG files libturbo-jpeg 4x DVI
Network

11. Streaming client and player:
JPEG2000 hardware decoder
• intoPIX Pristine4 solution
– SkyMicro MerlinIP board with FPGA Virtex5
– J2K encoding, decoding, streaming
– 4K 3D using two sync. cards
• New applications basing on Pristine4 SDK
– 4K 3D streaming module
– IPv6
– Multicast IPv4, IPv6
– Testing Future Internet networks (IPv6 implemented in PSNC)
– Network QoS measurement, QoE evaluation 8x HD-SDI
(4x dual link)
4x SDI-3G
Storage and
Streaming
Server Network
(RTP)
4x SDI-3G
8x HD-SDI
(4x dual link)
Streaming
Streaming client
4K 3D live server
(4x SDI-3G)
2x HD / 4K Cameras In 3D Rig

12. intoPIX to SONY SRX
• intoPIX Pristine4 connections
Infiniband
HDSDI Panel
Pristine4
3G 3G 3G 3G
HD-SDI
Dual
HD-SDI
w/Sound

13. intoPIX to 2x SONY SRX (3D)
• intoPIX Pristine4 connections (3D)
Infiniband
Infiniband
Pristine4
Pristine4
HDSDI Panel HDSDI Panel
3G
3G
3G
3G
sync
HD-SDI
Dual
HD-SDI HD-SDI
w/Sound Dual

14. Hardware development
• Hardware development team
– Group of 3 engineers
– Development of FPGA and electronic devices
• Ready to make necessary devices, e.g.: 4K3D HDSDI switch (single/dual/3G)
DOREMI
intoPIX Player
Player

15. 4K live interface for RED One
(prototype)
Lack of 4K live output! Transfer 4K signal to PC
hi-speed interface (USB, Ethernet)
RED One built-in live output in
720p only Decoding and debayerization
RED Rocket
Low level hardware development for
grabbing 4K live content Various output options:
Catching R3D stream from ATAPI HD SDI RED Rocket Breakoutbox
interface Showing 4K using graphics card
Encoding using intoPIX Pristine4
Real-time processing on FPGA chip
(JPEG2000) and network streaming
A real CF storage
For simultanous storage
Purposes (optional)
4x HD-SDI
Hi-Speed
USB 2.0 Graphics card
(480 Mbps) ATI v8800
JPEG2000
Encoder
CF Header
ATAPI Frame Grabber PC with (Intopix)
RED One 4K camera („True IDE” CF Card simulation) RED Rocket
Network
streaming

16. 4K live interface for RED One
• Schedule
– Proof of concept – mid 2011
• Presented on TNC2011 in Prague
and Cinegrid@Amsterdam
– Prototype
• Virtex6 evaluation kit
• Change from CF/ATAPI to SATA
• Change from USB to 1Gbit Ethernet
• Several problems to be resolved (SATA)
• Should be done 1Q2012
– Final device
• Dedicated board with Virtex6
• Planned 3Q2012
– Open question
• RED Epic support?
• We believe yes, however it’s not tested yet and will need some
testing

17. Demonstrations 2010/2011
Streaming 4K and 4K3D
JPEG2000 4K (intoPIX RTP)
JPEG 4K3D (software decoding)
JPEG2000 4K3D (intoPIX SDK)
From Poznań,PL to:
Colchester,GB (regular)
Vilnius,LT (TNC2010)
Geneve,CH (GLIF2010,HPDMNet)
Prague, CZ (TNC2011)
Amsterdam,NL (Cinegrid)

18. Cinegrid @ Amsterdam 2011
Case study
• Aim:
– to demonstrate JPEG2000 4K 3D streaming (Poznan-Amsterdam)
– using intoPIX Pristine4 system
– to provide 4K projectors for other demonstrations
• Things to do (1):
1. To do the working version of software:
• No 4K 3D functionality in Pristine4
• Unexpected bugs
– live555 library failed on 64-bit systems!
– No sound buffer implementation in intoPIX SDK (fixed quickly)
• Fully functional software ready day before conference!
– Tests with Univ. of Essex

19. Cinegrid @ Amsterdam 2011
Case study – things to do
• Things to do (2)
2. To move 2 SONY Projectors 900 km
• Rent a van and drive
• Pack all equipment and not to forget about anything important
• Set up and run on place

20. Cinegrid@Amsterdam 2011
Case study
• Things to do (3)
3. Establish network connection
• Network to the venue? No problem…
• For compressed 4K 3D we need just 1GbE
4. Convert video content
• Wrong colors in Holland Festival 4K 3D piece (Mullova)
• Another conversion took a lot of time
– graphics magick in several processes
• intoPIX had correct content on IBC fairs
– Brought 1h before screening
 

21. Conclusions:
Learning by doing
• To do the demonstration
– Good planning
– Can’t foresee all problems
– Need of some luck
– A lot of preparation and work
– Relax
Cinegrid@Amsterdam

22. Thank you