INOS VMOS Assessment Tool: Redefining Video Quality Assessment for OTT Video

The INOS Video Mean Opinion Score (VMOS) Assessment Tool represents a groundbreaking advancement in evaluating both User Quality-of-Experience (QoE) and Network Quality of Service (QoS) for adaptive video streaming on Facebook. By seamlessly merging these critical aspects, the tool delivers unparalleled benchmarking and optimization capabilities. Built upon an innovative architecture, it integrates high-performance analysis with a user-centric design, ensuring top-notch video quality evaluation across various platforms. Specifically designed for mobile phone testing, the VMOS Assessment Tool integrates seamlessly from the client side, making it ideal for efficient evaluation of mobile video performance.

Features:

Real-Time Analysis at Unprecedented Speed: Experience instantaneous, precise assessments with our tool’s advanced algorithms, ensuring rapid feedback and swift resolution of performance issues.

Enhanced QoE with ITU-T P.1204.3 Compliance: Aligned with the latest ITU-T P.1204.3 standards, the VMOS Assessment Tool offers refined evaluations that adhere to the most current benchmarks for perceptual video quality.

High-Quality Database Integration: Support for up to 8K resolution and 60 frames per second ensures comprehensive analysis of high-definition video content, enabling optimal performance and clarity.

Network QoS Optimization: Improve video playback with our tool’s focus on optimizing start-delay and buffering frequency, leading to smoother viewing experiences.

Integrated QoE and QoS Evaluation: The VMOS Assessment Tool seamlessly combines QoE and QoS metrics, providing a holistic analysis that ensures both user experience and network performance are optimized for superior video quality.

Flexible Device Compatibility and Viewing Distance: The VMOS Assessment Tool is designed to adapt to different streaming device dimensions, including PC, laptop, and mobile phone, and various viewing distances, ensuring optimal video quality regardless of the device or viewing conditions.

Seamless Platform Integration: Designed for effortless compatibility, the VMOS Assessment Tool integrates smoothly with existing video platforms, ensuring a hassle-free transition and minimal operational disruption.

Zero Client-Side Integration Required: The VMOS Assessment Tool manages the entire process, from video playback and network statistics recording to the final MOS score assessment, eliminating the need for any client-side integration.

Architecture Overview:

The INOS VMOS Assessment Tool encompasses multiple stages. Initially, it interacts with the video platform to obtain various encoded files, which are transmitted to the user network based on bandwidth availability. Subsequently, in the packet capturing phase, network packets are recorded into a PCAP file, along with the corresponding SSL decryption log key. During the packets processing phase, network packets are filtered to isolate only those related to video playback and player events. The final stage involves predicting the VMOS score by integrating video playback quality fluctuations, which reflect user QoS, with player events, which indicate network QoS.

INOS Facebook VQA Output Sample:

These output samples are derived from our Facebook quality testing on a mobile network operator in the United Kingdom. The results display a range of evaluation metrics utilized for the final VMOS assessment. Each performance metric is accompanied by geospatial testing locations on the map, time-domain values, and histogram values. The performance metrics will be discussed in the following points:

  1. Facebook Streaming Success:

This metric measures the success rate of logging into Facebook and streaming the video.

  • Facebook Streaming Start Delay:

This metric measures the time interval between the initiation of video loading and the commencement of video playback.

  • Facebook Streaming Buffer VMOS: 

This metric assesses the Network QoS VMOS, estimated from platform player events such as start delay, rebuffering event frequency, and rebuffering event duration relative to the original video duration.

  • Facebook Streaming Resolution per Second: 

This metric indicates the video playback resolutions per second, highlighting that Facebook frequently reduces the resolution to 540 pixels for mobile users.

This metric reflects the quality VMOS of video playback per second as a result of video quality fluctuations.

  • Facebook Streaming Quality VMOS:

This metric assesses the User QoE VMOS, indicating the Quality VMOS for the entire playback sequence, calculated from the Quality VMOS per second.

  • Facebook Streaming Final VMOS:

This metric represents the final VMOS score by merging both Network QoS and User QoE into a single score that encapsulates the overall experience.

INOS Tool Summary:

  • The INOS VMOS Assessment Tool is a Comprehensive Video Quality Evaluation tool for adaptive video streaming on Facebook, ensuring optimized user experience and network performance.
  • The Tool Features Innovative System Architecture by processing stages from obtaining encoded files, capturing and filtering network packets, to predicting the VMOS score.
  • The Tool Offers Advanced Real-Time Analysis with instantaneous, precise assessments and support for high-definition video content up to 8K resolution and 60 frames per second.
  • The Tool Provides Seamless Client-Side Integration for Mobile Testing, requiring no client-side integration and adapting to various device dimensions and viewing distances for efficient evaluation of mobile video performance.
  • The Tool Produces Detailed Output Samples for Comprehensive Evaluation.
  • The Tool Ensures Compatibility with Other Video Platforms, including YouTube, Shahid, TikTok, and Instagram.

We would like to extend our sincere thanks to Obeidallah Ali, our R&D Director at Digis Squared, for his invaluable contribution to this white paper. His expertise and insights have been instrumental in shaping this content and ensuring its relevance!

Eagle Eye: Revolutionizing Mobile Network Testing with INOS

Introduction

In the world of mobile network testing, efficiency and accuracy are crucial for optimizing network performance. The “Eagle Eye” feature in INOS is a powerful tool that enables users to analyze large data sets in logfiles, extracting valuable insights through geofencing. This feature facilitates data-driven decision-making for network optimization.

Unveiling “Eagle Eye”

The “Eagle Eye” feature in INOS allows users to effortlessly search through logfiles containing millions of samples, making it a reality. Unlike the traditional method that required meticulous effort in recalling file names, dates, and locations, “Eagle Eye” offers an intuitive solution. Users can define their area of interest using geofencing, and the feature retrieves all relevant data within that area, saving both time and effort.

Figure 1

Optimizing Search Results

“Eagle Eye” offers various settings to streamline the search process, allowing users to optimize and narrow down their results efficiently. These settings include:

  • Time Aggregation: Users can pick time granularity (hourly, weekly, or monthly) to analyze data over specific periods, aiding trend identification.
  • Distance Aggregation: Users can set the desired distance aggregation for a detailed location-based network performance analysis.
  • Operator MNC/MCC: Users can filter their search results based on specific Mobile Network Code (MNC) and Mobile Country Code (MCC).
  • KPI Selection: Users can choose the Key Performance Indicators (KPIs) they wish to extract from the logfiles.
  • Date Range and Time Clustering: Users can set a date range and cluster data in time to better understand network performance changes in specific periods.

Interpreting the Results

Once the search parameters are set, “Eagle Eye” presents users with an interactive map accompanied by a timeline.

Figure-2

“Eagle Eye” offers a user-friendly visual representation for easy navigation, providing insights into network performance across locations and timeframes. It also includes benchmark tables and histogram charts for comparative analysis and trend identification.

Use Case Scenarios

The application of “Eagle Eye” in INOS extends to various use cases like;

  • Pre-action Network Assessment
  • Performance Benchmarking
  • Team Performance Assessment
  • Investment Impact analysis
Figure-3
Figure-4

Conclusion

“Eagle Eye” in INOS is a game-changer for mobile network testing, with geofencing, result optimization, and visual representations that empower efficient insights extraction. It enhances decision-making, network performance, and operational excellence in mobile network testing.

INOS now available over AWS

INOS, Digis Squared’s vendor-agnostic, multi-network-technology solution delivering automated assessment, testing, post-processing and field optimisation of mobile networks, across all technologies, is now available as an AWS cloud-native tool.

The availability of INOS over AWS will enable Digis Squared’s clients to utilise the powerful mobile network testing and analytics capabilities with enhanced performance.

Abdelrahman Fady, Digis Squared CTO explained, “We’re excited to announce the deployment of INOS, our flagship product for network drive testing, benchmarking, post-processing and field optimisation over AWS. This deployment offers a host of benefits to our customers in the MNO industry, including a highly scalable and reliable infrastructure that can handle even the most demanding testing requirements.”

“With INOS’ advanced AI capabilities, our customers can gain predictive insights and automated optimizations that drive network efficiency and improve user experiences. This means that Digis Squared’s customers can proactively identify and address network performance issues, reducing downtime and improving overall network efficiency.”

“INOS’ deployment over AWS also means that Digis Squared’s customers can take advantage of a range of powerful tools and services that streamline network management, freeing up resources to focus on delivering value to their business. We’re thrilled to offer such a powerful and comprehensive solution to our customers and look forward to seeing the impact it has on their businesses.”

If you or your team would like to discover more about INOS over AWS, please get in touch: use this link or email hello@DigisSquared.com

What is INOS?

Digis Squared’s INOS is a vendor-agnostic, multi-network-technology solution delivering automated assessment, testing, benchmarking, post-processing and field optimisation of networks. Generating actionable reports in just 15 minutes, combined with live-view for instant adjustments, INOS significantly reduces the time taken to complete the work and opex cost, to deliver optimum customer experience.

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimization and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

Discover more

Digis Squared ◦ Enabling smarter networks.

INOS preview: new kits & new interface

At Mobile World Congress 2023, the “world’s largest and most influential connectivity event”, Digis Squared showcased a number of solutions. In this blog post Obeidallah Ali, Digis Squared RAN Automation Architect & INOS Product Manager, shares INOS previews from the Digis Squared MWC23 exhibition stand.

INOS preview at MWC23

At MWC23, the Digis Squared team showcased and previewed new INOS kits, and a new graphical user interface (GUI).

Preview: new INOS interface

The live demos on the Digis Squared exhibition stand included 4G and 5G analysis of the live mobile networks in Hall 7 at MWC23, and featured a real-time INOS dashboard with 6x specialist widgets.

  • Mobile monitoring status: battery status, script status, temperature, and log files. Enables mobile device control, including sending of new scripts, locking on a certain band, or shutting down and restarting the device.
  • Time charts of serving RSRP (power level) of 5G. (The video shows some spikes which may occur due to mobile movement or activity, which is considered normal.)
  • Map with satellite view, displays the precise location of the mobile device within Hall 7 at MWC23.
  • Table of Layer 3 messages, deep signalling layer information from the air interface.
  • Table of radio and mobile side events, including starting and ending scripts, and multiple radio events, such as attach/detach, RRC setup, and more.
  • Time charts and multiple KPIs for downlink and uplink throughput. During speed tests, the charts change dramatically and show test results in real-time.”

Preview: new INOS kits

At MWC23 the Digis Squared team previewed 5 new physical INOS kits, for different deployment and measurement scenarios,

  • Static: in-building continuous active measurement
  • Single device: highly portable
  • Backpack: for indoor assessment, or along narrow streets on foot, bicycle or moped, enabling access to tricky-to-reach locations
  • Compact: cost-efficient, light-weight and holding up to 6 devices
  • Drive testing: self-contained, rugged and portable kit, holding up to 26 devices.

INOS updates to chipset & handset support

MWC23: With thanks to Obeidallah Ali and the INOS team, and in particular R&D Engineer Yahia El-Ghayesh for his significant contribution to this demo and the development of the INOS kits.

INOS: Watch this space for further announcements!

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email hello@DigisSquared.com

What is INOS?

Digis Squared’s INOS AI tool, developed in-house, is a vendor-agnostic, multi-network-technology solution delivering automated assessment, testing, benchmarking and optimisation of networks. Generating actionable reports in just 15 minutes, combined with live-view for instant adjustments, INOS significantly reduces the time taken to complete the work and opex cost, to deliver optimum customer experience.

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimization and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

Discover more

Digis Squared ◦ Enabling smarter networks.

MWC 2023 recap & INOS preview

Mobile World Congress 2023, the “world’s largest and most influential connectivity event”, saw over 88,500 attendees join over 2,400 exhibitors, sponsors and partners, and over 1,000 speakers and thought leaders, in Barcelona at the end of February. Gwen Edwards, Digis Squared Marketing Director, recaps the team’s success, and shares INOS previews from the exhibition stand.

MWC is back, in full force

GSMA Mobile World Congress 2023 saw over 88k people visit the Fira Gran Via over 4 days, and with all the halls and the North entrance re-opened, there was a significant change in energy – the magic of MWC was back in full force!

Digis Squared team at MWC23

Digis Squared team at MWC23, end of day 2 – a busy day!

Participating as part of the UK Pavilion, the Digis Squared team had a full schedule of client and partner meetings – plus plenty of surprise opportunities to catch up with former colleagues and meet new connections in real-life for the first time.

The Digis Squared team at MWC23 with, from top left, clockwise, Chris Lundh CEO of client and partner Africell Angola, Abou Moustafa VP at Du, with partner Invigo, with the Tenacity Works team, with Wei Yeang (Max) Toh at Intel, and bottom left, the Omani Regulatory Team.

Work with our partners is vital to the projects we deliver for clients, and MWC23 enabled the Digis Squared team to highlight their INOS solution on the vast Intel exhibition stand. As a Gold member of the Intel Network Builders Program, and a member of the Intel Partner Alliance, Digis Sqaured collaborates closely with the valued Intel team.

MWC23 Intel Network Builders & Digis Squared

As part of the UK Pavilion at MWC23, and in collaboration with the Department for Business & Trade, Digis Squared participated in a Panel Discussion on “VR, AR & Network Optimization”, alongside Mike Jackson from UK Gov, Ed Greig FRSA from Deloitte Digital, and James Lee Burgess FRSA from UrbanXR

AR, VR& Network Optimization Panel Discussion: click through for video

MWC always delivers great networking opportunities, and the “Africa Mobile & Digital Economy Leaders Reception” was a special highlight this year.

African Business: Africa Mobile & Digital Economy Leaders Reception

New INOS hardware & GUI preview

Digis Squared used MWC23 to showcase a preview of the new form factors for INOS*, and the new fully-featured user interface. Watch this space for further INOS updates coming soon!

Thank you MWC23

The Digis Squared team were delighted to be back at MWC23 as part of the UK Pavilion, thrilled to be able to preview the new INOS interface and kits, and grateful to the brilliant Tradefair and UK Department for Business & Trade teams for all of their support.

The Digis Squared team are already making plans and looking forward to being back in Barcelona at MWC in 2024 – who knows, maybe next year we can fit the #DeloitteDigitalDog with INOS, and he can test coverage throughout every hall!

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email hello@DigisSquared.com

*What is INOS?

Digis Squared’s INOS AI tool, developed in-house, is a vendor-agnostic, multi-network-technology solution delivering automated assessment, testing, benchmarking and optimisation of networks. Generating actionable reports in just 15 minutes, combined with live-view for instant adjustments, INOS significantly reduces the time taken to complete the work and opex cost, to deliver optimum customer experience.

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimization and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

Discover more

  • Image credits: all images, as stated, and all others are copyright Digis Squared, except first image (Barcelona iStock).

Digis Squared ◦ Enabling smarter networks.

NFV deployment validation using INOS

Network Function Virtualization (NFV), is becoming increasingly important as mobile networks are being asked to handle an ever-growing number of connected devices and new use cases. In this article, Amr Ashraf, RAN and Software Solution Architect and Trainer, describes the benefits of NFV, capabilities and deployment considerations. Plus, we take a quick look at how Digis Squared’s powerful AI-tool, INOS, can help in the deployment validation of NFV.

Network Function Virtualization

Mobile virtualization – also known as network function virtualization (NFV) – is a powerful technology that has the capability to transform the way mobile networks are designed, deployed, and operated.

  • NFV enables the creation of virtualized mobile networks, and the isolation of different types of traffic on the same physical network infrastructure.
  • The creation of different virtual networks for different types of services or different user groups.
  • Multiple independent network operators to share a common infrastructure,
  • And improves the security of the network.

In this article, Amr Ashraf describes the benefits of NFV, capabilities and deployment considerations. Plus, we take a quick look at how Digis Squared’s powerful AI-tool, INOS, can help in the deployment validation of NFV.

The future of mobile network functions is virtual

Mobile virtualization is becoming increasingly important as mobile networks are being asked to handle an ever-growing number of connected devices and new use cases.

NFV & Infrastructure Sharing. One of the main benefits of mobile virtualization is that it allows for multiple independent network operators to share a common infrastructure. This can help to reduce the costs and complexity of building and maintaining mobile networks, and can also help to improve coverage and capacity in areas where it would otherwise be difficult or expensive to deploy new infrastructure.

NFV & Security. Mobile virtualization also helps to improve the security of the network by isolating different functions and providing a secure environment for each virtual network. This makes it an ideal solution for enterprise customers who need to maintain high levels of security for their sensitive data.

Deployment flexibility. Mobile virtualization is supported by software-based virtualized network functions (VNFs), which can be run on standard servers and storage systems, rather than specialized hardware. This makes it easy to scale and adapt the network to changing requirements. Additionally, it also makes it possible to deploy mobile virtualization solutions in a variety of different environments, including on-premises, in the cloud, or at the edge of the network.

NFV & 5G customisations. It’s worth noting that mobile virtualization is a key technology in building the 5G network. 5G network standards are designed to support network slicing, which can create multiple isolated virtual networks on top of a common physical infrastructure. This makes it possible to create customized solutions for different types of users and use cases, such as providing high-bandwidth services for multimedia applications, or low-latency services for industrial automation and control.

NFV is the future, and the future is now. Mobile virtualization is a rapidly evolving technology with considerable potential to transform the way mobile networks are designed, deployed, and operated. In the coming years, we expect to see more and more operators turning to mobile virtualization to meet the growing demands on their networks and stay competitive in the fast-changing mobile landscape.

Orchestration

Implementing mobile virtualization can present a number of technical challenges, including the management and orchestration of virtualized network functions (VNFs) and ensuring network security. Managing and orchestration of VNFs is a complex task, which involves provisioning and configuring VNFs, as well as ensuring their availability and performance. This is complicated by the fact that VNFs are software-based and can be deployed on a variety of hardware and virtualization platforms.

Security

As VNFs are software-based, they can be targeted by cyber-attacks just like any other type of software. Therefore, ensuring network security is vital when implementing mobile virtualization.

Additionally, virtualized networks may be vulnerable to new types of attacks that exploit the virtualization itself.

NFVO. One of the key solutions to these challenges is the use of network function management and orchestration (NFVO) systems. NFVOs automate the provisioning, configuration, and management of VNFs, and they help to ensure that the VNFs are highly available and perform well. They also play an important role in the orchestration of VNFs, which involves coordinating the actions of multiple VNFs to achieve a desired outcome.

Strong defences. Another key solution is the use of security solutions such as firewall, intrusion detection and prevention systems, secure VPN, and secure containers to protect the virtualized network, secure communication between virtualized functions, and protect virtualized infrastructure from unauthorized access.

Anomaly detection. Solutions based on artificial intelligence and machine learning can also be used to monitor and detect anomalies in the network, identify potential security threats, and take appropriate action to mitigate them.

Digis Squared recommend involving INOS Probe to undertake anomaly detection 24/7, and send these alerts to the CSP. Read more – Anomaly detection: using AI to identify, prioritise and resolve network issues.

Security strategy. In addition to these technical solutions, it’s also important to have a comprehensive security strategy in place to address any potential vulnerabilities and threats that may arise when implementing mobile virtualization. This can include implementing best practices for network design, conducting regular security assessments, and keeping systems and software up to date with the latest security patches and updates.

Skills & expertise. An often overlooked, yet important security consideration, is the need for skilled personnel who are well-versed in the technologies and best practices associated with mobile virtualization. As mobile virtualization is a complex technology that requires a deep understanding of network functions, security, and software development, it’s crucial to have a team of experts who can design, deploy, and maintain secure mobile virtualization solutions.

INOS & NFV

Drive testing can be used to validate the performance of virtualized network functions and ensure that they are providing the desired level of service. This can help to identify and troubleshoot any issues that may arise, such as poor performance or dropped connections. Drive testing can also be used to compare the performance of virtualized network functions with that of traditional, hardware-based network functions, in order to ensure that the virtualized functions are providing an equivalent or better level of service.

Digis Squared’s AI-solution INOS is an essential tool in the implementation and ongoing optimization of NFV. It helps to validate and troubleshoot virtualized network functions and ensure that they are providing an equivalent or better level of service compared to traditional, hardware-based network functions. Additionally, drive testing provides key information about the environment in which the network is deployed that can be used to optimize the deployment of virtualized network functions.

Conclusion

Mobile virtualization is a powerful technology that has the capability to transform the way mobile networks are designed, deployed, and operated. Key benefits it enables include,

  • The creation of virtualized mobile networks, and the isolation of different types of traffic on the same physical network infrastructure.
  • The creation of different virtual networks for different types of services or different user groups.
  • Multiple independent network operators to share a common infrastructure,
  • And improves the security of the network.

However, implementing mobile virtualization can present a number of technical challenges, including the management and orchestration of virtualized network functions (VNFs) and ensuring network security.

The use of network function management and orchestration (NFVO) systems, security solutions, AI/ML-based monitoring and anomaly-detection systems, and a comprehensive security strategy can help to mitigate these challenges.

Finally, NFV is a powerful, yet complex technology – it’s essential to work with an experienced team with deep expertise who can design, deploy, and maintain mobile virtualization solutions.

In conversation with Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer.

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email hello@DigisSquared.com

Find out more about INOS

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimization and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

See INOS in action at LEAP, Riyadh & MWC Barcelona

Digis Squared will be at LEAP in Riyadh at the start of February, as part of the UK Pavilion H4.G30, undertaking cloud-based INOS demos. Plus the team will be at MWC Barcelona at the end of February, with a full suite of all the INOS solutions and form factors on a dedicated exhibition stand Hall 7 B13.

Get in touch to arrange a dedicated time to meet: hello@DigisSquared.com

Discover more

Digis Squared ◦ Enabling smarter networks.

Intel® Network Builders Winners’ Circle 2022: GOLD

Gold membership

The Digis Squared team are thrilled to be a part of the Intel® Network Builders Winners’ Circle, and delighted to be awarded GOLD membership this year!

Digis Squared AI telecoms tools deployed as cloud-based solutions utilise Intel® Xeon® Gold processors, delivering optimised performance and enhanced speeds. Digis Squared’s AI-tools are also available as a ‘Radio-Testing-As-A-Service in the Intel Network Builders Edge and Networking Testbed.

The team are excited to be recognised by Intel for accelerating customer excellence and advancing 5G and virtual Network Transformation with the vibrant Intel Builders ecosystem.

“Working together with Intel, Winners’ Circle partners are driving the next generation of solutions and transforming the network from edge to core.”

Intel Network Builders, December 2022

Find full details of the Intel announcement here.

Anomaly detection: using AI to identify, prioritise and resolve network issues

Anomaly detection: efficiently identifying and resolving issues across mobile networks is vital for the success of any CSP or MNO. With 5G network deployment ramping up, and beyond that, work towards autonomous networks, the use of AI to handle anomalies is vital. In this article, Amr Ashraf, RAN and Software Solution Architect and Trainer, describes how CSPs can more efficiently identify and resolve the real issues hidden amongst all the noise.

This article is also available as a stand-alone paper, here.

Identifying the real issues hiding in all the noise

Data volumes are only going in one direction – there are substantial increases in data volume as more people connect online, with more devices, more solutions move to the cloud, continued changes in customer behaviour and movement of people and information across society, and more and more daily interactions move online. This increased volume of data also provides far greater noise for cyber threats to hide within. Whilst networks continue to perform well, and meet demand, efficient use of resources will become ever more important.

New tools and approaches are needed to be able to identify and resolve issues in all the noise.

Data from Statista, image credit World Economic Forum.

Anomaly detection and resolution: the role of AI

AI and ML provide the vital tools to handle this ever-growing volume of data. Soon – if not already – there will simply be too much data to analyse everything – but we can use AI to identify the unusual issues and outliers, and dig deeper into these anomalies.


The AI Hierarchy of Needs, Monica Rogati 2017
“How do we use AI and machine learning to get better at what we do?”. M.Rogati placed anomaly detection as a vital transformational step in providing a solid foundation for data before being effective with AI and ML.

Digis Squared & anomaly detection

Digis Squared’s INOS AI tool is a vendor-agnostic, multi-network-technology solution delivering automated assessment, testing and optimisation of networks, across all technologies. The data collected by INOS is analysed in the cloud-based AI engine, and it is here where anomalies are detected, assessed and actioned.

INOS: Three data collection methods

“INOS collects data in the field by one of three methods – a traditional “suitcase” format for drive testing, or a highly mobile backpack which can be used in narrow streets, or walking through shopping malls for example,” explains Amr Ashraf, RAN and Software Solution Architect and Trainer. “And this paper focusses on the third method, the static INOS active probe, and how the data it collects is analysed and actioned.”

A background image of a green landscape is overlaid with icons and photos of equipment. INOS

INOS active probe

“The active probe is a static box which is typically deployed inside a building – maybe a corporate HQ, a high-profile area within an airport, or a new business facility. Perhaps the location is selected because the CSP wants to proactively support a new VIP client, gather KPI data, or improve SLAs. Once deployed, the probe continuously monitors the networks, and data is streamed to the INOS platform in the cloud, where it is analysed by the INOS AI engine.”

“In the first step of the analysis, the data collected by the INOS active probe is used to identify QoE – the quality of experience – problems experienced by mobile devices in the probe. INOS will assess the data and carry out root-cause investigations to identify the fault that led to the problem. This is accomplished by gathering various performance measurements from several layers – the network, hardware, link, and operating system – which are then aggregated and delivered to INOS cloud.”

“To put it more specifically, the probe regularly initiates a test scenario while recording network, hardware, link, and OS measurements. Given that QoE problems can come from a variety of locations along the path, measuring the performance of each layer enables not only the detection of QoE problems, but also the determination of the problem’s root cause. A database on the INOS cloud receives aggregated metrics as soon as they are made available.”

Why use active probes?

“One of the best ways to understand how the end-user perceives the performance from beginning to end is using probes. They offer real-time and historical end-to-end call tracing, KPIs that continuously track network health and customer experience, and proactive alarming (QoE).”

“The two basic methods—probe measurements—that can improve performance and enrich end-to-end analysis (from the user terminal to the core network) are active and passive probe measurements, Because they give detailed information that enables service operators to assess the service quality across various transport technologies, probes play a significant role in the ever-increasing complexity of modern telecom networks.”

“By defining some parameters, the INOS probe uses AI models to detect anomalies in any field KPIs. For example, parameters such as deviation parentage and time windows can be used to calculate the deviation value. The example below for RSRP in LTE takes this approach, and identifies a deviation of 20%.”

INOS report of RSRP in LTE, identifying an anomaly with 20% deviation

“Additionally, INOS is able to assess data from other channels, including WhatsApp, Telegram, Twitter and email, and can assess behaviour of those apps for network anomalies too.”

Telegram Notification for a customer with certain Anomaly Detection

“To achieve the goal of end-to-end quality metrics, these probe measurements should be connected with numerous node-to-node performance data as well as customer data,” explains Amr.

“An integral view from the customer, network, service, or terminal perspective is provided by Digis Squared’s in-house developed INOS and RAI tools. Together these two AI-tools can proactively manage the network by continuously monitoring end-to-end KPIs, created from various perspectives in the network. They can immediately identify any deteriorating trends and anomalies, for example, dropped-call ratio and set-up times.”

“All Digis Squared’s tools are vendor agnostic – networks are such a complex mix of solutions, that our tools simply have to be able to work with and analyse data from all vendors. And, of course, they also handle data from all network technologies, legacy 2G platforms through to 5G, they’re designed for all of this.”

Prioritization: counter-intuitive approaches are sometimes best

The costs and impacts associated with low and medium-severity anomalies may be far greater than the total cost of high-severity issues – smaller issues are often harder to detect, and take longer to identify and implement a fix, so their compounded cost can be higher. AI can help ensure counter-intuitive approaches to assessing priority can be handled without bias.

“A proactive approach can save money in addition to ensuring high levels of customer satisfaction by reducing the number of trouble tickets and so optimizing resource allocation. The pre-defined INOS reports’ ability to show service quality makes root-cause investigation possible across all network layers.”

“Today, the Digis Squared AI tools are able to continuously receive data from active probes in the network, identify anomalies and negative trends. They are also able to identify root cause, and propose recommended solutions to fix the issue. Working with our clients, in some installations we enable those recommended fixes to be automatically implemented, ensuring that frequently occurring minor issues are identified and resolved automatically. Of course, all issues are included in reporting. This approach ensures that staff do not need to intervene in the mundane, predictable issues, and can instead focus on assessing the recommendations the system makes for more complex issues.”

Anomaly handling and autonomous networks

The use of AI in anomaly detection and, critically, resolution, has great value for legacy technologies, and even greater value for new technologies and transformations. It’s a vital step in network function virtualization (NFV), cloud-native computing (CNC) and software-defined networking (SDN) technologies. And provides important preparation for CSPs as they ready their organizations for operations based on autonomous networks.

“The Digis Squared INOS active probes are a vital tool in providing high-quality data on background network behaviour and performance,” shared Amr. “Using this, our AI tools are able to continuously assess the streamed data and identify anomalies, assess their root cause, and then propose and implement recommended actions. AI solutions like this will soon be the only way in which CSPs can efficiently identify and resolve the real issues hidden amongst all the vast quantities of noise.”

Find out more about INOS

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimization and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

In conversation with Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer.

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email hello@DigisSquared.com

Discover more

Digis Squared ◦ Enabling smarter networks.

Can you hear me now? AI-centred voice call quality testing

Can you hear me now?

In a world where mobile communication is focused on the use of apps and data, does the quality of a voice call still matter? And is it worth communications service providers (CSPs) spending effort on improving it?

In this blog post Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer argues that “Yes, it absolutely is! Voice quality, and particularly silence within calls – can you still hear me? – is one of the most tangible aspects of network quality for end users.”

Read on for insights into Digis Squared’s AI-centered voice call quality testing capabilities, using INOS.

If it’s important, we call.

Does voice quality still matter? “Yes! As voice technologies continue to evolve, and call costs drop, it continues to be important to ensure that the quality and clarity of voice calls is maintained,” explains Amr Ashraf, RAN and Software Solution Architect and Trainer.

“The phone call, the most basic and original capability of the mobile phone service, is also the most tangible for end users. Despite the huge range of apps we have on our phones, more often than not, it’s a voice call that’s used for communicating the most important, most sensitive and most urgent information.”

If we can’t clearly hear and understand what is being spoken on a call, or in a voice note, whichever app or method is used to connect or send the audio, then the customer’s perception is always that the network coverage or capacity is of low quality.

“If you find yourself saying ‘Can you still hear me? Are you still there?’, or thinking ‘What did they say?’, then the assumption is that the ‘fault’ is a poor quality service from the CSP”, says Amr. “Of all the aspects of a mobile network, voice quality is the strongest and most obvious indicator to an end-user of the quality of the service. Customers’ expectations of voice quality remain high, whichever technology the digitalised sound is transmitted over.”

Voice technologies today

Today, whilst some traditional mobile voice calls are still carried over legacy circuit-switched networks, calls made over 4G and higher, and for all app-based solutions, these digitalised sounds are transmitted as Voice over IP (VoIP), Voice over LTE (VoLTE) and Voice over WiFi (VoWiFi), all of which enable cost-effective ways to transport voice. Having a single solution that can assess voice quality across all technologies, in an automated and efficient way is vital – and in the web of complex multi-system networks, that AI-centred voice call quality testing solution must also work with solutions from all vendors.

INOS

Digis Squared’s INOS AI tool is a vendor agnostic, multi-network-technology solution delivering automated assessment, testing and optimisation of networks, across all technologies.

INOS & voice call quality testing

“If one of our clients – a CSP, MNO, MVNO or regulator – wants to better understand voice call quality on a specific mobile network, then we use our INOS AI tool to analyse the data,” shares Amr.

Image 1: voice codec rate. INOS analysis, for a specific drive test, on one mobile network, in Cairo

Notes on Image 1: For a voice call to be transmitted over the mobile network, it must first be digitized and compressed. Various standardized compression technologies, or codecs, are used to efficiently transmit the data. This image shows data collected during voice calls during a drive test, and the key on the left shows the codec used.

Enhanced Voice Rate (EVS) and Adaptive Multi-Rate (AMR) are audio compression formats used in the transmission of voice calls – EVS is a super-wide coding standard developed for VoLTE, and AMR is the older standard developed for GSM and UMTS (3G), sometimes called HD+.

Image 1 shows the variation in codec and compression rate utilised during test voice calls, made during a drive test. The changes in codec and compression rate are caused by changes in network coverage and capacity during the coverage, and will have resulted in fluctuations in call quality.

“Using INOS, we can simulate a customer call using the voice quality test to produce unbiased, industry-recognized audio quality scores,” explains Amr. “This test can reveal a great deal about your customers’ experience, as well as the quality of service being provided by your carrier. It also takes minimal preparation to undertake.”

Vital to this test is POLQA – Perceptual Objective Listening Quality Analysis – the global standard for benchmarking voice quality of fixed, mobile and IP-based networks. Standardized by the ITU in 2011, it is used for voice quality analysis of VoIP, HD Voice, 3G, 4G/VoLTE and 5G networks.

“So, whilst drive testing with the INOS kit, we set up a voice call and then use our own hardware solution to inject a POLQA reference audio into the voice call from one side of the call, and from the other side, we record the call, and then compare it using the POLQA algorithm.”

“Given that the POLQA reference audio is 6 seconds long, to analyse this data, we must split our call into audio files that are each only 6 seconds long. To ensure very precise splitting of the audio file, we leverage our AI engine to find the beginning of specific words in audio files. This way, we can ensure that we are aligning the analysis with natural speech patterns, and achieve a more realistic analysis of the data.”

Image 2: MOS score with 6 second sampling. INOS analysis, for a specific drive test, on one mobile network, in Cairo.

Notes on image 2: using data from the same drive test shown in image 1, now the data has been analyzed by INOS, and split into 6 second chunks, aligned with the start of specific spoken words in the audio file.

In telecoms, the Mean Opinion Score (MOS) is a numerical measure of the overall ranking of the quality of voice and video sessions. In image 2 above, we can see that on this journey, only a small minority of sections score the minimum 1 MOS (in black), and most of the call is green (MOS 3 and 4).

Image 3: MOS Score per call. INOS data, for a specific drive test, on one mobile network, in Cairo.

Notes on image 3: again using the same data as above, here the data is averaged out for specific calls, rather than 6 seconds chunks of a call shown in image 3.

INOS & silence within a call

“Silence within a call is a major problem with mobile phone conversations, and significantly impacts the customers’ perception of call quality. We’re all familiar with having to say ‘Can you still hear me? Are you there?’ whilst one of the people on the call is travelling in a car or bus,” continues Amr.

“To measure this, the Digis Squared team utilize our in-house AI capability within INOS to detect silence in voice calls, and analyse the percentage of silence.”

Image 4: Silence per call in seconds, INOS data, for a specific drive test, on one mobile network, in Cairo.

Notes on image 4: this analysis identifies areas where silence during the call was detected. Green indicates no silence, and in yellow, red and black are increasing amounts of detected silence.

INOS: automated, actionable voice call quality reports

INOS delivers automated voice quality reports, with customised KPIs, and actionable insights.

Amr concludes, “All our INOS reports can be fully customised, and are generated within 15 minutes of receipt of the data file, sent directly from the test devices in the field, over the air. What our clients find most useful is that not only are the reports conveniently formatted for immediate use, they also, thanks to our AI engine, clearly identify issues and provide actions which can be taken to address those issues. Data is no use without analysis, and the AI capabilities we have developed within INOS ensure that the analysis is fast, efficient and actionable.”

Find out more about INOS

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI-analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimisation and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

In conversation with Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer.

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email sales@DigisSquared.com

 

Discover more

About Digis Squared

Managed Services, System Integration & Consulting. We transform telecom networks, deploy new technologies, and manage vendors, for network operators, service providers and regulators. Apply our vendor-agnostic expertise, automated AI-led tools and processes to transform your technical and commercial capabilities. We work with agility, deep experience, and our in-house cognitive tools to optimise and manage multi-vendor networks across all technologies. Headquartered in the UK, Digis Squared has offices in Angola, Egypt and UAE.

Digis Squared ◦ Enabling smarter networks.

Product update: INOS used in Pre-Launch Testing for Africell Angola Network

As part of the recent successful commercial launch of Africell Angola, the Digis Squared AI-tool INOS, powered by Intel® Xeon® Scalable Processors, was used as a key part of the network cluster testing and acceptance process. Digis Squared’s Key Account Manager for Africell, Ahmed Ma’moon, shares more.

“Digis Squared manages the entire end to end Managed Services for the new Africell Angola mobile network*. Ahead of the commercial launch on 7th April, and working closely alongside our partners, we ensured that the network was tested robustly before launch.”  [*Read more about that, here.]

“Whilst the capabilities of our vendor-agnostic tool, INOS, are extensive, in the pre-launch phase of the Africell Angola project, its major role was in field optimization following the SSV (Single Site Verification) and sites acceptance phase. The team used INOS devices out in the field in vehicles to collect network performance data for all live sites. We were able to optimise our resources too – thanks to the ability to remotely update scripts, we didn’t need to send engineers out into the field; the INOS kit can be driven to a specific location and along a predefined route by anyone, and the data is automatically uploaded into the cloud immediately.”

What is a mobile network cluster?

Mobile network coverage is often drawn as a honeycomb-like pattern of neatly meshing hexagons.

In reality, the coverage is not neatly tessellated hexagons, but very irregular shapes, due to the landscape, buildings and other features, and coverage from adjacent cells may overlap, or there may be some thin gaps. Mobile network planning engineers allocate different frequency bands (also called channels) to neighbouring cells – this helps to minimise interference even when coverage areas overlap slightly. The group of cells on different bands is known as a cluster.

INOS for Cluster Optimisation

Ahmed continues, “Working from Digis Squared’s offices, our engineers were able to control and update scripts remotely, push revised routes to drivers, and review data live in the cloud during the tests. During the pre-launch phase we ran field measurements using INOS for Luanda province clusters and sub-clusters, undertook the analysis to identify coverage issues, implemented optimisation changes live on the network, and then re-tested and benchmarked the results against the initial data.”

Above: Example INOS dashboard for field measurements used for analysis and optimization

“INOS’ AI-capabilities ensure that analysis of vast amounts of data is completed very rapidly – within 15 minutes of uploading data – so we were able to assess the results, implement fixes and re-run the tests very swiftly.”

Above: Sample coverage analysis algorithms in INOS

Comprehensive pre-launch testing to optimise for post-launch excellence

“INOS was a vital tool for us in the pre-launch field optimization activities for Africell Angola, to ensure best network coverage and performance, and excellent user experience after launch. INOS helped to speed up the field optimization process for all Luanda clusters, and complete the work in advance of the scheduled launch date.”

INOS & Intel

“INOS was a vital tool for us in the pre-launch field optimization activities for Africell Angola, to ensure best network coverage and performance, and excellent user experience after launch. INOS helped to speed up the field optimization process for all Luanda clusters, and complete the work in advance of the scheduled launch date.”

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI-analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimisation and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors.

In conversation with Ahmed Ma’moon, Digis Squared’s Key Account Manager for Africell Group.

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email sales@DigisSquared.com .

Discover more

Digis Squared, independent telecoms expertise.

Image credits: all images, Digis Squared