Can you hear me now? AI-centred voice call quality testing

Can you hear me now?

In a world where mobile communication is focused on the use of apps and data, does the quality of a voice call still matter? And is it worth communications service providers (CSPs) spending effort on improving it?

In this blog post Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer argues that “Yes, it absolutely is! Voice quality, and particularly silence within calls – can you still hear me? – is one of the most tangible aspects of network quality for end users.”

Read on for insights into Digis Squared’s AI-centered voice call quality testing capabilities, using INOS.

If it’s important, we call.

Does voice quality still matter? “Yes! As voice technologies continue to evolve, and call costs drop, it continues to be important to ensure that the quality and clarity of voice calls is maintained,” explains Amr Ashraf, RAN and Software Solution Architect and Trainer.

“The phone call, the most basic and original capability of the mobile phone service, is also the most tangible for end users. Despite the huge range of apps we have on our phones, more often than not, it’s a voice call that’s used for communicating the most important, most sensitive and most urgent information.”

If we can’t clearly hear and understand what is being spoken on a call, or in a voice note, whichever app or method is used to connect or send the audio, then the customer’s perception is always that the network coverage or capacity is of low quality.

“If you find yourself saying ‘Can you still hear me? Are you still there?’, or thinking ‘What did they say?’, then the assumption is that the ‘fault’ is a poor quality service from the CSP”, says Amr. “Of all the aspects of a mobile network, voice quality is the strongest and most obvious indicator to an end-user of the quality of the service. Customers’ expectations of voice quality remain high, whichever technology the digitalised sound is transmitted over.”

Voice technologies today

Today, whilst some traditional mobile voice calls are still carried over legacy circuit-switched networks, calls made over 4G and higher, and for all app-based solutions, these digitalised sounds are transmitted as Voice over IP (VoIP), Voice over LTE (VoLTE) and Voice over WiFi (VoWiFi), all of which enable cost-effective ways to transport voice. Having a single solution that can assess voice quality across all technologies, in an automated and efficient way is vital – and in the web of complex multi-system networks, that AI-centred voice call quality testing solution must also work with solutions from all vendors.

INOS

Digis Squared’s INOS AI tool is a vendor agnostic, multi-network-technology solution delivering automated assessment, testing and optimisation of networks, across all technologies.

INOS & voice call quality testing

“If one of our clients – a CSP, MNO, MVNO or regulator – wants to better understand voice call quality on a specific mobile network, then we use our INOS AI tool to analyse the data,” shares Amr.

Image 1: voice codec rate. INOS analysis, for a specific drive test, on one mobile network, in Cairo

Notes on Image 1: For a voice call to be transmitted over the mobile network, it must first be digitized and compressed. Various standardized compression technologies, or codecs, are used to efficiently transmit the data. This image shows data collected during voice calls during a drive test, and the key on the left shows the codec used.

Enhanced Voice Rate (EVS) and Adaptive Multi-Rate (AMR) are audio compression formats used in the transmission of voice calls – EVS is a super-wide coding standard developed for VoLTE, and AMR is the older standard developed for GSM and UMTS (3G), sometimes called HD+.

Image 1 shows the variation in codec and compression rate utilised during test voice calls, made during a drive test. The changes in codec and compression rate are caused by changes in network coverage and capacity during the coverage, and will have resulted in fluctuations in call quality.

“Using INOS, we can simulate a customer call using the voice quality test to produce unbiased, industry-recognized audio quality scores,” explains Amr. “This test can reveal a great deal about your customers’ experience, as well as the quality of service being provided by your carrier. It also takes minimal preparation to undertake.”

Vital to this test is POLQA – Perceptual Objective Listening Quality Analysis – the global standard for benchmarking voice quality of fixed, mobile and IP-based networks. Standardized by the ITU in 2011, it is used for voice quality analysis of VoIP, HD Voice, 3G, 4G/VoLTE and 5G networks.

“So, whilst drive testing with the INOS kit, we set up a voice call and then use our own hardware solution to inject a POLQA reference audio into the voice call from one side of the call, and from the other side, we record the call, and then compare it using the POLQA algorithm.”

“Given that the POLQA reference audio is 6 seconds long, to analyse this data, we must split our call into audio files that are each only 6 seconds long. To ensure very precise splitting of the audio file, we leverage our AI engine to find the beginning of specific words in audio files. This way, we can ensure that we are aligning the analysis with natural speech patterns, and achieve a more realistic analysis of the data.”

Image 2: MOS score with 6 second sampling. INOS analysis, for a specific drive test, on one mobile network, in Cairo.

Notes on image 2: using data from the same drive test shown in image 1, now the data has been analyzed by INOS, and split into 6 second chunks, aligned with the start of specific spoken words in the audio file.

In telecoms, the Mean Opinion Score (MOS) is a numerical measure of the overall ranking of the quality of voice and video sessions. In image 2 above, we can see that on this journey, only a small minority of sections score the minimum 1 MOS (in black), and most of the call is green (MOS 3 and 4).

Image 3: MOS Score per call. INOS data, for a specific drive test, on one mobile network, in Cairo.

Notes on image 3: again using the same data as above, here the data is averaged out for specific calls, rather than 6 seconds chunks of a call shown in image 3.

INOS & silence within a call

“Silence within a call is a major problem with mobile phone conversations, and significantly impacts the customers’ perception of call quality. We’re all familiar with having to say ‘Can you still hear me? Are you there?’ whilst one of the people on the call is travelling in a car or bus,” continues Amr.

“To measure this, the Digis Squared team utilize our in-house AI capability within INOS to detect silence in voice calls, and analyse the percentage of silence.”

Image 4: Silence per call in seconds, INOS data, for a specific drive test, on one mobile network, in Cairo.

Notes on image 4: this analysis identifies areas where silence during the call was detected. Green indicates no silence, and in yellow, red and black are increasing amounts of detected silence.

INOS: automated, actionable voice call quality reports

INOS delivers automated voice quality reports, with customised KPIs, and actionable insights.

Amr concludes, “All our INOS reports can be fully customised, and are generated within 15 minutes of receipt of the data file, sent directly from the test devices in the field, over the air. What our clients find most useful is that not only are the reports conveniently formatted for immediate use, they also, thanks to our AI engine, clearly identify issues and provide actions which can be taken to address those issues. Data is no use without analysis, and the AI capabilities we have developed within INOS ensure that the analysis is fast, efficient and actionable.”

Find out more about INOS

INOS can be implemented as a public or private cloud, or on-premise solution, and is also available as a “Radio Testing as-a-service” model. Its extensive AI-analysis and remote OTA capabilities ensure speedy and accurate assessment of all aspects of network testing: SSV, in-building and drive testing, network optimisation and competitor benchmarking, across all vendors, network capabilities and technologies, including 5G, private networks and OpenRAN.

INOS is built with compute resources powered by Intel® Xeon® Scalable Processors. Digis Squared is a Partner within the Intel Network Builders ecosystem program, and a member of the Intel Partner Alliance.

In conversation with Amr Ashraf, Digis Squared’s RAN and Software Solution Architect and Trainer.

If you or your team would like to discover more about our capabilities, please get in touch: use this link or email sales@DigisSquared.com

 

Discover more

About Digis Squared

Managed Services, System Integration & Consulting. We transform telecom networks, deploy new technologies, and manage vendors, for network operators, service providers and regulators. Apply our vendor-agnostic expertise, automated AI-led tools and processes to transform your technical and commercial capabilities. We work with agility, deep experience, and our in-house cognitive tools to optimise and manage multi-vendor networks across all technologies. Headquartered in the UK, Digis Squared has offices in Angola, Egypt and UAE.

Digis Squared ◦ Enabling smarter networks.

INOS ◦ Now more than ever, know your network strengths, and weaknesses

Understand what has changed, then invest

As work patterns continue to change, operators struggle to model their network capacity and investment plans. Understanding current network coverage, performance and quality of experience, and that of competitors, is vital before investment decisions are made.

Our cloud-controlled INOS automated testing platform delivers both drive testing, and in building data, enabling operators and service providers to efficiently obtain the insights needed for key upgrade decisions. [Our tools need just one person in the vehicle or building – no engineers are needed on-site, ensuring that they can do their work safely and together we can keep our communities connected.]

Know your strengths, and weaknesses. Now more than ever, ensure you know the capability, performance, quality of experience and coverage of your voice and data networks, and that of your competitors, before you invest. Discover more about how INOS can help you, here.

Now more than ever, use INOS to benchmark coverage, performance & QoE.

To discuss how our network benchmarking expertise can help your business, please use this link or email sales@DigisSquared.com to arrange a convenient time for an informal conversation.

Keep up to speed with company updates, product launches and our quarterly newsletter, sign up here.

Digis Squared, independent telecoms expertise.

Image credit: Klavs Taimins

E2E radio services ◦ Now more than ever, use independent expertise to manage your multi-technology, multi-vendor networks

Ensuring telecom network infrastructure is managed efficiently is complex – highly interconnected globally, expensive infrastructure with a large base of legacy systems and technologies, combined with multiple vendors and interoperability concerns, plus demanding customers expectations.

Managing the complex commercial and technical issues of E2E Radio Services should not be under-estimated.

With the rollout of 5G, and growth in IoT deployments, additional stress is added to the operational teams as they grapple to gain the knowledge needed to successfully optimise and manage the new capabilities, and evolving commercial expectations.

This growth in operational demands, in combination with the extra strain on communications systems created by COVID-19 globally, means that even more efficient methods of delivering end to end radio services are needed.

“Operators will need to consider new ways of generating capex efficiency as they strive to meet growing demand for high-speed and low-latency data services.”

Source: EY (1)

Competency development

With so much change occurring simultaneously, as well as high operational demands, finding the time to invest and deliver training is difficult but vital. At Digis Squared our teams understand this, and have developed training solutions which can be delivered remotely, or on-site when social distancing and travel permits.

We ensure MNO staff-readiness for the future, and emergencies, as well as developing their capabilities to robustly address today’s demands.

Missing skills, poor data quality and a lack of long-range planning are holding back the transformation agenda.

Source: EY (2)

Independent expertise

As a flexible and experienced independent partner, we help service providers fill in the gaps in their end to end radio services capabilities – whether that’s through providing resources to address short-term skills gaps, strategy advice, new analysis tools, innovative solutions, or bespoke competency development, we are there when we are needed, providing expertise across the entire network lifecycle: R&D, strategy, planning, integration, in-field, optimisation & benchmarking, operations & support, customer care.

Relentlessly focussed consulting

In a multi-vendor, multi-technology field, ensuring interoperability and identifying areas of improvement is complex – our team is independent, business-aligned and relentlessly focused on realizing the value of your network. Digis Squared consulting services steer you towards the networks of tomorrow, anticipating changing commercial, technical, regulatory and customer demands, and developing detailed strategies and plans to ensure your business can address them.

“5G will play a critical role in the digital economy for decades to come. This new era of intelligent connectivity offers the chance to recast customer value propositions, accelerate industrial transformation, and reinvigorate the digital society.

Source: EY (2)

RAN solutions

Our services scale to help our customers manage increases in network complexity, and growth of network traffic effectively and efficiently. We provide the expertise necessary to support your network transformation goals, with our multi-vendor and multi-technology capabilities, our services adapt to meet the emerging needs of your network.

Innovation

We leverage state-of-the-art techniques to help service providers to design, deploy and operate the latest network technologies, so that they can provide the new services subscribers want, while ensuring network quality remains high, E2E radio services are optimised and operating margins respectable.

  • 5G: our teams accelerate the transformation of mobile networks, enabling new services, new applications & even new industries. Digis Squared provides end to end support for service providers to deploy their 5G networks, starting with planning support, and extending to 5G network optimization
  • Automation & software solutions: Automation is key to ensuring operational efficiency as network complexity increases. The Digis Squared RAI solution delivers powerful integrated capabilities, using AI & ML, providing network insights, configuration management and performance monitoring processes, and energy saving. We build tailored automation solutions for MNOs, to help them address any challenge.
  • IoT: The driving force of digital transformation, IoT has complex technology requirements, including a cascade network architecture consisting of massive number of devices, and each design has a different design objective. Optimizing the network and delivering the required capacity and coverage for each IoT use case are challenging tasks for IoT implementations, and our solutions address them.
  • Drive-less tuning: Minimizing drive test (DT) efforts, our INOS solution automates all reporting types i.e. SSV, customer complaints and cluster benchmarking. Robotic post-processing capabilities help MNOs to speed up logfiles analysis, as well as resolving field problems.

In a world of technical and commercial complexity, seeking an independent experienced voice to guide your teams, and extra resources when you need them, will help ensure that your E2E Radio Services are fully optimised and able to handle new technology from new vendors.

Now more than ever, use independent E2E radio expertise to manage your multi-technology, multi-vendor networks.

To discuss how our E2E Radio Services experts can help your business, please use this link or email sales@DigisSquared.com to arrange an informal conversation.

Keep up to speed with company updates, product launches and our quarterly newsletter, sign up here.

Sources

Image credit: James Padolsey