5G-MAG Reference Tools:
Bringing 5G Media to Life
February 2024
Dr. Jordi J. Giménez
gimenez@5g-mag.com
WHO WE ARE
© 2024
International non-for-profit cross-industry association
© 2024
Global Internet, 5G-based access & APIs
for media applications and services
© 2024
Global Internet, 5G-based access & APIs
for media applications and services
NETWORK FEATURES
OPEN APIs
SPECTRUM ACCESS
STREAMING
APP
IMMERSIVE
DEVICES
COMPUTING
EDGE
CODECS
CDNs
BROADCAST
MULTICAST
UNICAST
QoS
NETWORK ASSISTANCE
NTN
TRANSPORT
RENDERING
AVATARS
ASSETS
XR
NPN
GAMING
ECOSYSTEM
ENERGY EFFICIENCY
SCALABILITY
TIMING
5G-MAG Reference Tools DevelopmentProgramme
WHAT WE DO
5G-MAG Reference Tools underdevelopment
5G Downlink Media
Streaming (5GMSd)
5G Core Network
components
Multimedia delivery
protocols
MBMS & LTE-based 5G
Broadcast
Emergency Alerts
over 5G Broadcast
5G Multicast
Broadcast Services
XR Media
integration in 5G
AI/ML Evaluation
Framework
5G Media Streaming network components
developed so far:
5GMS Application Server
Wrapping OpenResty (Nginx)
5GMS Application Function
Built in the Open5GS framework.
5G Media Streaming Client components
developed so far on Android:
5GMS-enabled Media Player
Wrapping ExoPlayer.
Media Session Handler
Background service.
5GMS-Aware Application
App, optionally incorporating the Media
Player component.
Some examples under development
?
5G-MAG Reference Tools
Data Network
5G-MAG Reference Tools
User Equipment
5GMSd Client
Media Stream Handler
Media Player
Open5GS
srsRAN
N6
N29 N30
N5
N4 N7
N3
Uu
UPFNG-RAN
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M1
server
M3
client
M5
server
M3 server
HTTP daemon
5GMSd Application
Provider
M5
client
Config.
Signal
M5d
M3d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M1
client
M8
M2d
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Data
Collection
AF
R6
client
Event
Consumer
AF
R6
server
R6
R4 client
R4
server
R4
Service Access
Information
SMF
NEF
5G-MAG Reference Tools 5G Media Streaming (downlink) functional map
<[email protected]> [2.March.2023]
Access
log
stream
Access
log
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
Service Access
Information
M1d
BSFPCF
© 2024
Some examples under development
Amplifier + TX
Exciter
RF
Modulator / eNodeB
digital I/Q data
MCE
MME
MBMS-GW
(Sync)
BM-SC
Content Provider
M1 (data)
,
M2 & S1 (ctrl)
xMB: ctrl & data
Broadcast Core
Stationary reception
rt-wui / VLC / dash.js /
rt-mbms-mw
(with rt-libflute)
rt-mbms-modem
(using srsRAN) SDR
Qualcomm QRD or CRD
rt-mbms-mw-android
QC MBMS MW
Baseband (HW)
with QC SW to enable ROM
ffmpeg
RTP MPEG-TS
or HLS/DASH
via rt-libflute
srsRAN mbms-gw
rt-mbms-tx
SDR (BladeRF,
Lime, Ettus, …)
© 2024
Some examples under development
© 2024
5G-MAG Reference Tools @ IBCShow 2023
© 2024
5G-MAG Reference Tools @ IBCShow 2023
© 2024
HOW TO
PARTICIPATE
Contribute
15
All development is happening on
Github
Dedicated project boards for each
new feature:
https://github.com/orgs/5G-
MAG/projects
Getting started guide for each topic,
e.g., 5G Downlink Media Streaming:
https://github.com/5G-
MAG/Getting-Started/wiki
All information at
https://github.com/5G-MAG
© 2024
github.com/5G-MAG
*We accept code under the license terms
contributors feel comfortable with
(check each of the 30+ repos)
Participate
17
tinyurl.com/join5gmagslack
Discussions around
development of features
and resolving issues.
Dedicated channels for
each project
tinyurl.com/join5gmaggroup
Announcements of
upcoming meetings, new
release candidates and
new releases
5g-mag.com/community
Public Calls
Last Friday of the month
13:00 - 14:30 CEST
Internal Calls
Fridays - every other week
13:00 14:30 CEST
Calls
© 2024
5g-mag.com/community
Its
5G MEDIA
PRODUCTION
Its
UPLINK VIDEO
Its
STREAMING
Its
5G BROADCAST
Its
MULTICAST
Its
BEYOND 2D
Its
XR
Its
Who is contributing?
26
© 2024
THANK YOU!
developer.5g-mag.com
developer.5g-mag.com
In more details
5G-MAG Reference Tools
developer.5g-mag.com
5G-MAG Reference Tools underdevelopment
5G Downlink Media
Streaming (5GMSd)
5G Core Network
components
Multimedia delivery
protocols
MBMS & LTE-based 5G
Broadcast
Emergency Alerts
over 5G Broadcast
5G Multicast
Broadcast Services
XR Media
integration in 5G
AI/ML Evaluation
Framework
developer.5g-mag.com
Implementing
5G Media Streaming Architecture
30
© 2024
GitHub Repositories:
5GMSd Application Function (rt-5gms-application-function)
5GMSd Application Server (rt-5gms-application-server)
5GMSd Media Session Handler (rt-5gms-media-session-handler)
5GMS Examples (rt-5gms-examples)
5GMS Common Android Library (rt-5gms-common-android-library)
5GMS Media Stream Handler (rt-5gms-media-stream-handler)
5GMS-Aware Applications (rt-5gms-application)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/5G-Downlink-Media-Streaming
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
31
© 2024
5G Media Streaming network components
developed so far:
5GMS Application Server
Wrapping OpenResty (Nginx)
5GMS Application Function
Built in the Open5GS framework.
5G Media Streaming Client components
developed so far on Android:
5GMS-enabled Media Player
Wrapping ExoPlayer.
Media Session Handler
Background service.
5GMS-Aware Application
App, optionally incorporating the Media
Player component.
Under development
?
5G-MAG Reference Tools
Data Network
5G-MAG Reference Tools
User Equipment
5GMSd Client
Media Stream Handler
Media Player
Open5GS
srsRAN
N6
N29 N30
N5
N4 N7
N3
Uu
UPFNG-RAN
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M1
server
M3
client
M5
server
M3 server
HTTP daemon
5GMSd Application
Provider
M5
client
Config.
Signal
M5d
M3d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M1
client
M8
M2d
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Data
Collection
AF
R6
client
Event
Consumer
AF
R6
server
R6
R4 client
R4
server
R4
Service Access
Information
SMF
NEF
5G-MAG Reference Tools 5G Media Streaming (downlink) functional map
<[email protected]> [2.March.2023]
Access
log
stream
Access
log
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
Service Access
Information
M1d
BSFPCF
© 2024
Under development: 5GMS Features (Update: January24)
33
5G Media Streaming
feature
5GMS Application Function
5GMS Client
Provisioning (M1) Usage (M5)
Content hosting
Pull
-based
Done
Done
QoE metrics reporting
Pending release
Pending release
Pending release
Consumption reporting
Done
Done
Done
Network Assistance
Delivery boost
Not applicable
Done
To do
Throughput estimation
Not applicable
To do
To do
Dynamic Policies
Done
Done
To do
Not implemented and welcome…
5GC with support for PCF
5GC with support for NEF
© 2024
34
© 2024
5GMSd Application Function (rt-5gms-application-function/releases)
Release v1.4.0 - 5GMS Application Function
Adds Consumption Reporting, Network Assistance, Dynamic Policies
Enhancements: ACME certificate management, Improved validation on API communications, Uplift all interfaces to comply with 3GPP TS 26.512 V17.7.0.
From previous releases…
Implementation of the interfaces at reference point M1 for: Provisioning Session (TS 26.512 clauses 4.3.2 & 7.2), Content Protocols Discovery (TS 26.512 clauses
4.3.4 & 7.5), Server Certificates (TS 26.512 clauses 4.3.6 & 7.3), Content Hosting Configuration (TS 26.512 clauses 4.3.3 & 7.6)
5GMS Application Function M3 API
5GMSd Application Server (rt-5gms-application-server/releases)
Release v1.2.2 - 5GMS Application Server
Adds Consumption Reporting
Feature: TS 26.512 v17.7.0 uplift
From previous releases…
Add Certificate handling for HTTPS distribution
Add M3 interface
5GMSd Media Session Handler (rt-5gms-media-session-handler/releases)
Release v1.1.0 - 5GMS Media Session Handler
5GMS Consumption reporting: Add support to Media Session Handler
Dispatch information about locationReporting and accessReporting to the Media Stream
From previous releases…
Adds a MediaSessionHandlerMessengerService to establish a bidirectional messenger endpoint with the Media Stream Handler.
5GMSd Media Stream Handler (rt-5gms-media-stream-handler/releases)
Release v1.1.0 - 5GMS Media Stream Handler
Initial support for 5GMS Consumption reporting
Add support for location reporting
From previous releases…
Adds an ExoPlayerAdapter that implements the M7 interface.
Release Highlights
35
© 2024
5GMSd Application (rt-5gms-application/releases)
Release v1.1.0 - 5GMS Application
Request access to ACCESS_FINE_LOCATION to support location property when doing consumption reports
Request permission for getting GPSI for Consumption Reporting
From previous releases…
Visualize the selected bitrate and the selected Representation as an overlay on top of the video
Move to Media3 for Exoplayer dependency
Adds a user interface to select between different M8 data/endpoints and to select the target stream to be played.
Allows for adding new M8 endpoints either via a local .json file or via a server endpoint.
Adds a network interface to fetch M8 information
Exo-DVB-I Player: The Exo DVB-I Player uses the Android ExoPlayer and the DVB-I Reference Client functionality to provide the capabilities to select and play back
media content.
5GMS Common Android Library (rt-5gms-common-android-library/releases)
Release v1.1.0 - 5GMS Common Android Library
5GMS Consumption reporting: Add support in common Android library
Multiple changes related to Consumption Reporting that add required model classes and new Util functions
Add new events to be dispatched to enable location reporting
Add logic to derive either domain name or the IP address from a request URL
5GMS Examples (rt-5gms-examples/releases)
Release v1.0.0 - 5GMS Examples
Adds a simple express.js server to mock functionality of the Application Function. The first route m8.js is used to return information about the available services
and the available base URL to the Application Function. The 5GMSd Aware Application uses this route as M8 interface. The second route service-access-
information.js provides the corresponding ServiceAccessInformation to the data that is returned via M8.
Release Highlights
36
© 2024
Projects:
5GMS Application Server for MVP#1
5GMSd Application
Provider
Origin server
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS AS component
Big Buck
Bunny
Big Buck
Bunny
5GMSd AS
Config.
translator
HTTP daemon
Config.
Signal
M4d
5GMSd-Aware Application
M6
client
M7
client
M7 server
M7
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
5G-MAG Reference Tools 5G Media Streaming (downlink) Minimum Viable Product #1
<[email protected]> [9.September.2022]
Access
log
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
ContentHosting
Configuration
.json
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
M8
ServiceAccess
Information
.json
(TS 26.512 clause C.4.1)
Manual
translation
Started with a single static Content Hosting
Configuration file (JSON) following the syntax
defined in TS 26.512 clause C.3.5.
Exposes a virtual host at reference point M4d.
Changes to HTTP redirect handling by the 5GMS
AS have been made recently.
5GMS:
Basic media stream handling (MVP#1)
Kanban board
© 2024
Projects:
5GMS Application Function for MVP#2
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS Media Session
Handler component
5GMS AS component
5GMS AF component
5GMSd AS
Media
Session
Handler
5GMSd AF
M5
server
Config.
translator
HTTP daemon
M5
client
Config.
Signal
M5d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Service Access
Information
5G-MAG Reference Tools 5G Media Streaming (downlink) Minimum Viable Product #2
<[email protected]> [23.August.2022]
Access
log
Content Hosting
Configuration
Service Access
Information
ServiceAccessInformation
(TS 26.512 clause C.4.1)
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
5GMSd Application
Provider
Origin server
Big Buck
Bunny
Big Buck
Bunny
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
ContentHosting
Configuration
.json
Started with a single static Content Hosting
Configuration file (JSON) following the syntax
defined in TS 26.512 clause C.3.5.
Exposes corresponding Service Access
Information at M5d.
No further development work planned on
Application Function under MVP#2.
5GMS:
Media session handling (MVP#2)
Kanban board
© 2024
Projects:
5GMS: M3 link
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS Media Session
Handler component
5GMS AS component
5GMS AF component
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M5
server
M3 server
HTTP daemon
M5
client
Config.
Signal
M5d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Service Access
Information
5G-MAG Reference Tools 5G Media Streaming (downlink) M3 link
<[email protected]> [5.October.2022]
Access
log
Content Hosting
Configuration
Service Access
Information
ServiceAccessInformation
(TS 26.512 clause C.4.1)
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
5GMSd Application
Provider
Origin server
Big Buck
Bunny
Big Buck
Bunny
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
ContentHosting
Configuration
.json
M3
client
M3d
AS now configured by the AF and no longer
accepts a static Content Hosting Configuration.
Model: AS maintains a flat list of server certificates
and a flat list of Content Hosting Configurations.
Initial implementation checked in to AS and AF
repositories, including uplift of M3d API to track
changes in M1d API as TS 26.512 V17.3.0.
No further work planned until Content Publishing
Configuration for uplink media streaming is
agreed (Release 18).
5GMS:
M3 link (AF to AS RESTful OpenAPI)
Kanban board
© 2024
Projects:
5GMS: M1 provisioning
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS Media Session
Handler component
5GMS AS component
5GMS AF component
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M5
server
M3 server
HTTP daemon
M5
client
Config.
Signal
M5d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Service Access
Information
5G-MAG Reference Tools 5G Media Streaming (downlink) M1 Provisioning
<[email protected]> [2.December.2022]
Access
log
Service Access
Information
ServiceAccessInformation
(TS 26.512 clause C.4.1)
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
5GMSd Application
Provider
Origin server
Big Buck
Bunny
Big Buck
Bunny
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
ContentHosting
Configuration
.json
M3
client
M3d
M1
server
M1
client
M1d
Provisioning
Sessions
M8d
ServiceAccess
Information
.json
(TS 26.512 clause C.4.1)
Application Function now configured via the M1d
API and longer accepts a static Content Hosting
Configuration.
Implemented first three APIs at M1d:
Provisioning Sessions API.
Server Certificates Provisioning API.
Content Hosting Provisioning API.
Uplift to comply with TS 26.512 V17.3.0.
(Fraunhofer FOKUS currently implementing the
Metrics Provisioning API.)
Next planned development by BBC:
Policy Templates Provisioning API.
5GMS:
M1d Provisioning
Kanban board
© 2024
Projects:
5GMS: Network Assistance
5GMS AF component
5GMSd Application Function
M5
server
5G Core Network Functions
N5
N4 N7
UPF
SMF BSF
Nbsf_Management
Npcf_PolicyAuthorization
PCF
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS Media Session
Handler component
5GMS AS component
5GMSd Application Server
Media
Session
Handler
M3 server
HTTP daemon
M5
client
Config.
Signal
M5d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Service Access
Information
5G-MAG Reference Tools 5G Media Streaming (downlink) PCF Integration
<[email protected]> [6.July.2023]
Access
log
Service Access
Information
ServiceAccessInformation
(TS 26.512 clause C.4.1)
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
5GMSd Application
Provider
Origin server
Big Buck
Bunny
Big Buck
Bunny
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
ContentHosting
Configuration
.json
M3
service
consumer
M3d
M1
server
M1
client
M1d
Provisioning
Sessions
M8d
Provisioning
Session ID
PCF
service
consumer
BSF
service
consumer
Aiming to support both delivery boost and
throughput estimation (bit rate recomm.).
Developed new service consumer libraries for
communicating with the Binding Support Function
(BSF) and Policy & Charging Function (PCF).
Integration into 5GMS AF underway:
(No M1 provisioning: static configuration only .)
Additional Service Access Information at M5 for use
by the Media Session Handler.
Implement M5 Network Assistance API.
(Uplift of 5GMS AF to recently published TS 26.512
V17.5.0 already complete.)
Additional development of the Media Session
Handler needed to invoke M5 APIs.
5GMS:
Network Assistance and Dynamic Policies features
Kanban board
© 2024
Projects:
5GMS: Dynamic Policies
5GMS AF component
5GMSd Application Function
M5
server
5G Core Network Functions
N5
N4 N7
UPF
SMF BSF
Nbsf_Management
Npcf_PolicyAuthorization
PCF
5GMS Media Stream
Handler component
Media Stream Handler
Media Player
5GMS Test App component
5GMS Media Session
Handler component
5GMS AS component
5GMSd Application Server
Media
Session
Handler
M3 server
HTTP daemon
M5
client
Config.
Signal
M5d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Service Access
Information
5G-MAG Reference Tools 5G Media Streaming (downlink) PCF Integration
<[email protected]> [6.July.2023]
Access
log
Service Access
Information
ServiceAccessInformation
(TS 26.512 clause C.4.1)
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
5GMSd Application
Provider
Origin server
Big Buck
Bunny
Big Buck
Bunny
M2d
Big Buck
Bunny
(TS 26.512 clause C.3.5)
ContentHosting
Configuration
.json
M3
service
consumer
M3d
M1
server
M1
client
M1d
Provisioning
Sessions
M8d
Provisioning
Session ID
PCF
service
consumer
BSF
service
consumer
Reuse service consumer libraries for
communicating with the BSF and PCF.
Development work in the 5GMS AF:
Implement M1 Policy Templates API.
Additional Service Access Information at M5 to
support the Media Session Handler.
Implement M5 Dynamic Policies API.
Corresponding changes to the Media Session
Handler needed to invoke these at M5.
5GMS:
Network Assistance and Dynamic Policies features
Kanban board
© 2024
Projects:
5GMS: QoE Metrics Collection & Reporting
Metrics Measurement and Logging Client:
Performs the measurement and logging of QoE
metrics in accordance with the Metrics Reporting
Configuration part of provisioning data, supplied by
the 5GMSd Application Provider to the 5GMSd AF,
and forwarded by the 5GMSd AF to the Media Player
via the Media Session Handler.
Initial implementation of QoS metrics and
consumption collection and reporting
Aim to support multiple metric schemes. In
particular:
For downlink media streaming, TS 26.247 clauses
10.6.1 and 10.6.2 specify the required MIME content
type and metrics report format for the 3GPP
urn:3GPP:ns:PSS:DASH:QM10 metrics reporting
scheme
5GMS:
QoE metrics collection and reporting feature
Kanban board
?
5G-MAG Reference Tools
Data Network
5G-MAG Reference Tools
User Equipment
5GMSd Client
Media Stream Handler
Media Player
Open5GS
srsRAN
N6
N29 N30
N5
N4 N7
N3
Uu
UPFNG-RAN
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M1
server
M3
client
M5
server
M3 server
HTTP daemon
5GMSd Application
Provider
M5
client
Config.
Signal
M5d
M3d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M1
client
M8
M2d
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Data
Collection
AF
R6
client
Event
Consumer
AF
R6
server
R6
R4 client
R4
server
R4
Service Access
Information
SMF PCF
NEF
5G-MAG Reference Tools 5G Media Streaming (downlink) functional map
<[email protected]> [20.October.2022]
Access
log
stream
Access
log
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
Service Access
Information
M1d
© 2024
Projects:
5GMS: Consumption Collection & Reporting
Consumption Measurement & Logging Client:
Performs the measurement and logging of content
consumption-related information in accordance with
the Consumption Reporting Configuration part of
provisioning data, supplied by the 5GMSd Application
Provider to the 5GMSd AF, and forwarded by the
5GMSd AF to the Media Player via the Media Session
Handler.
Initial implementation of QoS metrics and
consumption collection and reporting
Aim to support multiple metric schemes. In
particular:
For downlink media streaming, TS 26.247 clauses
10.6.1 and 10.6.2 specify the required MIME content
type and metrics report format for the 3GPP
urn:3GPP:ns:PSS:DASH:QM10 metrics reporting
scheme
5GMS:
Consumption collection and reporting feature
Kanban board
?
5G-MAG Reference Tools
Data Network
5G-MAG Reference Tools
User Equipment
5GMSd Client
Media Stream Handler
Media Player
Open5GS
srsRAN
N6
N29 N30
N5
N4 N7
N3
Uu
UPFNG-RAN
5GMSd Application Server
Media
Session
Handler
5GMSd Application Function
M1
server
M3
client
M5
server
M3 server
HTTP daemon
5GMSd Application
Provider
M5
client
Config.
Signal
M5d
M3d
M4d
5GMSd-Aware Application
M6
server
M6
M6
client
M7
client
M1
client
M8
M2d
M6
server
M7
M7
M7
client
M6
Consumption
Collection & Reporting
QoE metrics
Collection & Reporting
Network Assistance
Dynamic QoS
Data
Collection
AF
R6
client
Event
Consumer
AF
R6
server
R6
R4 client
R4
server
R4
Service Access
Information
SMF PCF
NEF
5G-MAG Reference Tools 5G Media Streaming (downlink) functional map
<[email protected]> [20.October.2022]
Access
log
stream
Access
log
M7 server
M6
client
Consumption
measurement
and logging
QoE metrics
measurement
and logging
Media access
client
Media
decapsulation
Media
decryption
Media
decoding
Media
presentation
Service Access
Information
M1d
© 2024
developer.5g-mag.com
Implementing
5G CoreNetwork components
GitHub Repositories:
5G Core Service Consumers (rt-5gc-service-consumers)
UE Data Collection Application Function (rt-5gc-data-collection-application-function)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/5G-Core-Network
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
46
© 2024
47
© 2024
5GC Service Consumers (rt-5gc-service-consumers/releases)
Release v1.0.0 - 5GC Service Consumers
This is the first release of the 5G Core Service Consumer libraries and tools. These are based upon the Open5GS 5G Core and can be used as an independent set
of tools for testing or controlling 5G Core APIs or as libraries for adding API handling into your own Open5GS based AF implementations.
Initial commit of the Service Consumer libraries and tools
Service Consumer Libraries: Various bug fixes and improvements
Release Highlights
48
© 2024
49
© 2024
Projects:
5GC: Service consumer libraries & test app
The 5GMS AF needs to communicate with
the 5G Core in order to manipulate network
Quality of Service (QoS) for ongoing media
streaming sessions.
Solution: reusable service consumer
libraries to invoke service operations on:
Binding Support Function (BSF).
Policy & Charging Function (PCF).
Could also be exploited by future functions
(MBSF, MBSTF, etc.)
Also developing a command line PCF test
application.
To test libraries against another 5G Core.
5GMS:
Network Assistance and Dynamic Policies features
Kanban board
50
© 2024
51
© 2024
Projects:
5GC: Data Collection, Reporting & Event Exposure
Exposure of UE Data to other Network
Functions in the 5G System (e.g. NWDAF,
third-party AFs,…).
Implementation of a standalone Data
Collection AF able to receive generic data
reports from the UE and expose them as
events to event consumers.
Implementation in a shared library able to
be integrated into the 5GMS AF.
The project complements the client-side
collection and reporting for QoE metrics
and consumption.
5GMS:
UE data collection, reporting and event exposure
Kanban board
52
© 2024
Implementing
Multimediacontent deliveryprotocols
developer.5g-mag.com
GitHub Repositories:
FLUTE Library for LTE-based 5G Broadcast / MBMS (rt-libflute)
ROUTE integrated within MBMS Middleware (rt-mbms-mw/tree/route-gpac)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/Multimedia-content-delivery
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
54
© 2024
55
© 2024
Implementation of FLUTE (File Delivery over Unidirectional Transport) library
IETF RFC 6726
With FEC Rapor10 support
MBMS:
Support for FLUTE
Kanban board
Projects:
Support for FLUTE
56
© 2024
Implementation of ROUTE (Real-time Transport Object delivery over Unidirectional Transport)
library to extract a DASH/HLS live filesystem from a ROUTE/IP session
What it implements at the server side:
ROUTE over multicast IP (UDP);
Partial segments can be dispatched. Needed for low latency
3 flavours: generic ROUTE (RFC), ATSC3, DVB MABR - updates according https://www.ietf.org/rfc/rfc9223.html
Not implemented: EXT_NOP/EXT_TIME, and optionally EXT_AUTH if used; Congestion; FEC (RAPTORQ as in RFC
6330)
What it implements at the client side:
3 flavours: generic (RFC), ATSC3, ATSC3 Korean, DVB MABR - updates https://www.ietf.org/rfc/rfc9223.html
ROUTE over multicast IP (UDP);
Skip repeated files;
Low latency;
Partially implemented: File repair simple option:
MPEG-2 TS: all lost ranges are adjusted to 188-bytes boundaries, and transformed into NULL TS packets.
ISOBMFF: all top-level boxes scanned, incomplete boxes are transformed in free boxes, except mdat.
Not implemented: Reorder (with timeout); Choose service ID to bootstrap on for ATSC 3.0 mode; FLUTE (as
documented in in RFC 3926 and TS 26.346); Congestion; FEC (RAPTORQ as in RFC 6330)
MBMS:
Support for ROUTE
Kanban board
Projects:
Support for ROUTE
57
© 2024
developer.5g-mag.com
Implementing
MBMS & LTE-based5G Broadacast
59
© 2024
60
© 2024
61
© 2024
GitHub Repositories:
5G Broadcast Transmitter (rt-mbms-tx)
Transmitter for QRDs and CRDs (rt-mbms-tx-for-qrc-crd)
MBMS Middleware (rt-mbms-mw)
MBMS Modem (rt-mbms-modem)
Web User Interface for Modem, MW & Application (rt-wui)
MBMS Examples (rt-mbms-examples)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/MBMS-&-LTE-based-5G-Broadcast
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
62
© 2024
Under development
Amplifier + TX
Exciter
RF
Modulator / eNodeB
digital I/Q data
MCE
MME
MBMS-GW
(Sync)
BM-SC
Content Provider
M1 (data)
,
M2 & S1 (ctrl)
xMB: ctrl & data
Broadcast Core
Stationary reception
Application
Middleware
Modem (HW)
Reception on mobile
Application
Middleware (Android)
Baseband (HW)
© 2024
Under development
Amplifier + TX
Exciter
RF
Modulator / eNodeB
digital I/Q data
MCE
MME
MBMS-GW
(Sync)
BM-SC
Content Provider
M1 (data)
,
M2 & S1 (ctrl)
xMB: ctrl & data
Broadcast Core
Stationary reception
rt-wui / VLC / dash.js / …
rt-mbms-mw
(with rt-libflute)
rt-mbms-modem
(using srsRAN) SDR
Qualcomm QRD or CRD
rt-mbms-mw-android
QC MBMS MW
Baseband (HW)
with QC SW to enable ROM
ffmpeg
RTP MPEG-TS
or HLS/DASH
via rt-libflute
srsRAN mbms-gw
rt-mbms-tx
SDR (BladeRF,
Lime, Ettus, …)
© 2024
65
© 2024
LTE-based 5G Broadcast Transmitter (rt-mbms-tx/releases)
Release v1.0.0 LTE-based 5G Broadcast Transmitter
This is the first release of the LTE-based 5G Broadcast Transmitter. This implementation is based on the existing MBMS implementation in srsRAN_4G eNodeB,
modified to include a feature set of 3GPP Rel-17 LTE-based 5G Terrestrial Broadcast. It also includes a basic MBMS gateway which creates a virtual network
interface sgi_mb which receives IP multimedia traffic.
MBMS Modem (rt-mbms-modem/releases)
Release v1.2.1 MBMS Modem
Enables automatic gain control configuration for the SDR reader via the configuration file
From previous releases…
Rebase to srsRAN. Important: This links to the fembms branch of srsRAN: https://github.com/5G-MAG/srsRAN/branches
Support for MIMO / dual RX streams from BladeRF
MBMS Middleware (rt-mbms-mw/releases)
Release v0.10.0 - MBMS Middleware
Add support for seamless switching between broadcast and unicast delivery for HLS streams
Add support for three different service announcement formats as document
Add support for seamless switching demo via flute-ffmpeg watchfolder approach
Web User Interface (rt-wui/releases)
Release v0.1.0 Web User Interface
Add support for seamless switching between broadcast and unicast streams for HLS content
Update to dash.js 4.4.0
From previous releases…
Provide DASH manifest url directly to application.js if available
Provide HLS manifest url directly to application.js if available
MBMS Examples (rt-mbms-examples/releases)
Release v0.2 MBMS Examples
Add support for seamless switching using the flute ffmpeg watchfolder approach
From previous releases…
Adds an example implementation to demonstrate rt-mbms-mw usage without the rt-mbms-modem part.
Release Highlights
66
© 2024
Implemented so far…
End-to-end support for LTE-based 5G Terrestrial Broadcast
Standalone 5G Broadcast transmitter and basic MBMS gateway (Release 14)
Standalone 5G Broadcast transmitter for QRDs and CRDs (Rel 9 with Receive-Only Mode capabilities)
MBMS Modem/Receiver (Release 17)
MBMS Middleware
Web User Interface for PHY layer and signaling parameters with integrated player
Implementation of FLUTE and ROUTE libraries for the MBMS Modem
Support of DASH, HLS and RTP playback over 5G Broadcast
Support for seamless switching (only HLS) between unicast and broadcast
Not implemented and welcome…
Uplift of 5G Broadcast transmitter to Release 18
Seamless switching and Android middleware support for DASH
Further development of MBMS gateway
Development of BM-SC with xMB interface
Under development: What is missing?
67
© 2024
Software-defined radio (SDR)-based modem with support of:
Receive-only mode services within a mixed carrier (support of Rel-14 ROM)
Receive-only mode services in a dedicated carrier (support of Rel-14, Rel-16 and Rel-17 features)
Dedicated 5G Broadcast SDR modem implements the following Rel-16 features:
Increased CAS robustness
PBCH repetition
Semi-static CFI in MIB
New PDCCH format 4: 16 CCEs / 144 REGs
New subcarrier spacings 0.37 kHz, 1.25 kHz and 2.5 kHz
Dedicated 5G Broadcast SDR modem implements the following Rel-17 features:
Support for 6/7/8 MHz MBSFN subframes
Other improvements:
Merged features from all branches (dual-rx, mixed mode, …) into development
Took care of warnings: Now builds clean again with GCC 11.4 at -Wall -Wextra -Wpedantic -Werror
Brought srsRAN_4G up to latest main branch revision from SRS
Improved MIB decoding for dedicated cells, was getting confused by MBSFN symbols
Speed up startup/synchronisation: SDR is only retuned if parameters have changed
Fixed PDSCH resource allocation for 1.4MHz / 6 PRBs
MBMS:
MBMS Modem - Rel 17 Support
Kanban board
Projects:
5G Broadcast SDR-based Modem
68
© 2024
Work on two versions of transmitters oriented to:
Receive-only mode services within a mixed carrier (support of Rel-14 ROM for CRD/QRDs)
Receive-only mode services in a dedicated carrier (support of Rel-14, Rel-16 and Rel-17 features)
MBMS:
5G Broadcast Transmitters
Kanban board
Projects:
5G Broadcast Transmitters
69
© 2024
Web User Interface (rt-mbms-wui)
Interfaces via RESTful API to rt-mbms-
modem and rt-mbms-mw
Useful for checking
basic reception parameters
Middleware file list
and service announcement
Contains HLS and DASH players
New features added for visualization of
advanced parameters
MBMS:
Web User Interface
Kanban board
Projects:
Web User Interface
70
© 2024
Seamless switching between broadcast and OTT/unicast content delivery
Enables flexible usage of bandwidth
Broadcast on demand: services can be dynamically provisioned when the demand is there, otherwise
viewers are on OTT / using CDN download
Off-peak times are freed for e.g. content prepositioning / data services
Any mix is possible, e.g.
24/7 radio channels with robust coding and SCS 2.5kHz for high mobility
4 TV channels at 1080p / 3 Mbps during the day, but only one at UHD / 12 Mbps for a sports game in
the evening
Mobility scenarios between MBSFN areas: can carry same MBMS service
MBMS:
Seamless switching between broadcast & unicast
Kanban board
Projects:
5G Broadcast & Hybrid Unicast-Broadcast
71
© 2024
developer.5g-mag.com
Implementing
Emergency Alertsover 5G Broadcast
73
© 2024
GitHub Repositories:
5G Broadcast Transmitter (rt-mbms-tx)
Transmitter for QRDs and CRDs (rt-mbms-tx-for-qrc-crd)
MBMS Middleware (rt-mbms-mw)
MBMS Modem (rt-mbms-modem)
Web User Interface for Modem, MW & Application (rt-wui)
MBMS Examples (rt-mbms-examples)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/Emergency-Alerts-5G-Broadcast
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
74
© 2024
Under development…
Initial support of SIB12 delivery over eNodeB
Not implemented and welcome…
Development of MME with interface to CBC
Development of CBC and interface to MME
Development of CBE generating CAPv1.2 to CBC
Mapping of CAPv1.2 to SIB12
Under development: What is missing?
75
© 2024
Implementation of Cell Broadcast Service functions
Cell Broadcast Entity (CBE)
Cell Broadcast Center (CBC)
Implementation of interface CBE-CBC with Common Alerting Protocol v1.2 (CAP v1.2)
Implementation of interface SBc between CBE and MME
MBMS: Public Warning System
Kanban board
Projects:
Emergency Alerts over 5G Broadcast
76
© 2024
developer.5g-mag.com
Implementing
5G Multicast-Broadcast Services (MBS)
78
© 2024
GitHub Repositories:
Under development
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/5G-Multicast-Broadcast-Services
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
79
© 2024
Start with Broadcast mode in RAN and 5G Core
MVP#0: only user plane MB-UPF
MVP#0.1: user plane and control plane* MB-UPF, MB-SMF* and AMF*
Under development: 5MBS Masterplan
AMF MB-SMF
Uu
N2
N1
N16mb
N4mb
N19mb
UDM
Nmb9
N29mb
Nmb2
N33
PCF
N7mb
Nmb5
N4
N3
N3mb
Nmb1
Nmb12
N10
MBSF
NEF
N11
N11mb
N30
Nmb13
NG-RAN MBSTF
UE
MB-UPF
AF/
AS
SMF
UPF
N6mb
Nmb10
Nmb8
N5
Why? Less complexity (MBS session management,
implementation)
Continue with Multicast mode in 5G Core (only
shared subset with Broadcast)
© 2024
Under development: Progress
© 2024
Under development: Progress
© 2024
Under development…
Initial support of MB-UPF in 5GC
Not implemented and welcome…
Support for MBS in gNodeB
MBS User Services
Linux-based Modem with MBS support
Under development: What is missing?
83
© 2024
Initial implementation of MB-UPF and basic multicast capabilities in the 5G Core
5MBS:
5G Core functions (MB-UPF)
Kanban board
Projects:
5G Core functions for MBS
84
Start with Broadcast mode in RAN
and 5G Core
MVP#0: only user plane MB-
UPF
MVP#0.1: user plane and control
plane* MB-UPF, MB-SMF* and
AMF*
Why? Less complexity (MBS session
management, implementation)
Continue with Multicast mode in 5G
Core (only shared subset with
Broadcast)
© 2024
developer.5g-mag.com
Implementing
XR Media integrationin 5G
86
© 2024
At the moment these GitHub Repositories are private:
XR Unity Player (rt-xr-unity-player)
XR Blender Exporter (rt-xr-blender-exporter)
Efficient glTF 3D import / export package for Unity (rt-xr-gITFast)
XR Content (rt-xr-content)
XR MAF Plugin (rt-xr-maf-plugin)
XR MAF Native (rt-xr-maf-native)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/XR-Media-integration-in-5G
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
87
© 2024
These repositories are currently under development and testing
Early access for testing can be requested using the form available at
www.5g-mag.com/early-access
Content Playback
Unity and Unreal Engine 5 are widely used
for the creation of 3D experiences
An open-source XR Player based on Unity
Plugins is available (an XR Web Player is
expected too)
Player is able to load at runtime a 3D
scene and render it to create an
immersive expériences
Open-source will help developers to get
started with standardized technologies
and their integration into 5G-MAG
Content Creation
Blender is an open-source and widely
used 3D authoring tool with native support
for glTF
Extended Blender for authoring Metaverse
3D scenes
Open-source project to close the loop on
content creation/consumption
Project in has recently been released
through 5G-MAG
Enables developers to create content and
ship players that can consume it
Under development: XR Media Integration in 5G
© 2024
Next steps into integration with 5G
Enable QoS suppoted asset component streaming and download
Support both DASH and WebRTC
Interface with MSH to request QoS for multiple streams
Contributions are solicited
Under development: XR Media Integration in 5G
© 2024
All issues related to the release of version 1.0.0 of the XR repositories dealing with functionalities
defined in ISO/IEC 23090-14
More information soon, please check: www.5g-mag.com/tutorials
Background information is available here:
Slides: https://www.khronos.org/developers/linkto/gltf-2.0-extensions-in-mpeg-and-3gpp-
real-time-exchange-formats-for-3d-experiences
Video: https://www.khronos.org/developers/linkto/gltf-2.0-extensions-in-mpeg-and-3gpp-
real-time-exchange-formats-for-3d-experiences-vid
White paper: https://mpeg.org/wp-
content/uploads/mpeg_meetings/140_Mainz/w22138.zip
XR: Repositories with
ISO/IEC 23090-14:2023 functionalities - Release 1.0.0
Kanban board
Projects:
XR repos with ISO/IEC 23090-14 functionalities
90
© 2024
developer.5g-mag.com
Implementing
AI/ML Evaluation Framework
At the moment these GitHub Repositories are private:
Evaluation Framework for AI/ML (rt-ai-ml-evaluation-framework)
Find in our GitHub the following resources:
https://github.com/5G-MAG/Getting-Started/wiki/AI-ML-Evaluation-Framework
Specifications and architecture
On-going projects
Using the tools
Related repositories
Available Resources
92
© 2024
These repositories are currently under development and testing
Early access for testing can be requested using the form available at
www.5g-mag.com/early-access
This project is the implementation of the AI/ML evaluation framework as defined in 3GPP SA4
TR 26.847.
The purpose is to establish an evaluation framework and use it for the evaluation of scenarios
collected for the 3GPP FS_AI4Media study. This includes the collection of scenarios based on
the use cases identified, and defining a scenario template for the description of scenarios for
the evaluation.
AI/ML:
Evaluation Framework
Kanban board
Projects:
AI/ML Evaluation Framework
93
The evaluation framework documents
common testbed architectures and
anchors, metrics (e.g. AI/ML task metrics,
feasibility/performance metrics), and
specific details (such as test
configuration and constraints) for each
scenario evaluation.
© 2024
developer.5g-mag.com
Extras for 5G-MAG members
Currently 10 encoding recipes available, reach
out if you’re looking for something else
Free cloud-based encoding service for
experimentation in scope of 5G-MAG
Reference Tools
Leveraging Dolby’s professional infrastructure
(Hybrik)
Best effort and limited support for contributors
(no SLA)
Free demo and testing licenses are made
available by Dolby Laboratories to 5G-MAG
members.
Please contact Kurt Krauss at
Encoding service from Dolby Laboratories
95
© 2024
Supports FeMBMS (3GPP Release 14 up to 18) and eMBMS (Release 9/12 mixed
mode for Android prototype handsets CRD/QRD)
Channel bandwidths 3, 5, 6, 7, 8 and 10 MHz
Subcarrier spacings (Δf) of 0.37, 1.25, 2.5, 7.5 and 15 kHz
Supports ETWS/cell broadcast warning message distribution via SIB12
RESTful API for configuration, control and status to allow for integration into an
existing web interface or configuration system
Data and control inputs through standardised M1, S1 and M2 interfaces,
compatible with 3GPP-compliant 5G Broadcast cores
Output of modulated I/Q data via Ethernet
Supports demos and trials through direct ingress of traffic and local configuration,
and can output I/Q data via USB directly to BladeRF SDRs
Free demo and testing licenses are made available by Bitstem to 5G-MAG members.
Please contact Klaus Kühnhammer at klaus@bitstem.com
5G Broadcast Modulator from Bitstem
96
© 2024
5G Broadcast Core
FeMBMS, LTE-based terrestrial broadcast (3GPP Releases 14, 16, 17), eMBMS (Release 9/12 mixed mode for Android
prototype handsets CRD/QRD)
Operable in 5G BC standalone or connected mode for broadcast-broadband solutions
Runs on-premise or in the cloud
Interoperability with different transmitter vendors and emergency warning systems by supporting 3GPP interfaces:
xMB, M1, M2, M3, CAP
High availability through redundancy on-premise or in the cloud
5G Broadcast middleware
Standalone app for use-case tests
Easy integrable into existing apps for commercial use
Hybrid connect
Broadband load monitoring
Dynamic provisioning of 5G Broadcast cores
Reports and insights
Free demo and testing licenses for the 5G Broadcast core are made available to 5G-MAG members
Please contact Johann Mika at jo[email protected] (More info at www.nakolos.com)
Nakolos: 5G Broadcast meets Broadband
Nakolos, a joint-project by ORS Group and Bitstem GmbH develops products
and solutions for content providers and broadcast network operators to
utilize the combination of 5G Broadcast and Broadband.
97
© 2024
developer.5g-mag.com
5G-MAG Reference Tools in use
Conferences and Publications
99
© 2024
Demos @ IBCShow 22
100
5G-MAG
Nakolos
(ORS/Bitstem)
Fraunhofer FOKUS
© 2024
5G-MAG Reference Tools Demos 2023
101
FOKUS Media Web Symposium 2023
BBC R&D Open Day 2023
IEEE International Symposium on
Broadband Multimedia Systems and
Broadcasting (BMSB) 2023
www.5g-mag.com/events
© 2024
5G-MAG Reference Tools @ IBCShow 2023
© 2024
5G-MAG Reference Tools @ IBCShow 2023
© 2024
DEVELOPER XCHANGES
Developers present their implementations and progress with the 5G-MAG Reference Tools.
Take a look at https://www.5g-mag.com/tutorials
5G-MAG PARTICIPATES IN OSMART WORKSHOPS
The OSMART (Open-Source Media Application Reference Tools) workshop is a regular
exchange involving the development of open-source software for media applications with
a series of status updates and roadmaps on relevant projects from relevant organizations.
Find more information: https://www.5g-mag.com/osmart and join the community at
https://github.com/osmart-community/
DEVELOPER XCHANGES & WORKSHOPS
104
© 2024
Join our open communities Follow us
Stay tuned!
Daniel Silhavy
5G-MAG Reference Tools Development Coordinator
daniel.silhavy@fokus.fraunhofer.com
This presentation
uses images
from flaticon.com and unsplash.com