Bringing the power of “and” to the car

QNX unveils a new platform at TU-Automotive Detroit and celebrates an acoustics milestone

Paul Leroux

Some people assume that, when it comes to cars, QNX is mostly about infotainment. Or telematics. Or safety. Or security. But in reality, QNX is about all of these things. So, for a better picture of what QNX brings to the car, simply replace all of those ‘or’s with ‘and’s. For an even better picture, add more things to the list. Like instrument clusters. And handsfree systems. And virtualization.

When you put all of these ‘and’s together, you begin to realize that QNX is a platform for the entire automotive cockpit. So why is that important? Well, more than ever, cars are defined by their software. In fact, automakers are now building cars in which half a dozen systems need a high-level OS. Using a single OS platform for all of those systems can consolidate development efforts, increase interoperability, encourage code reuse, reduce training costs, boost productivity, and just plain make things easier. Of course, it doesn’t hurt if that same platform is also secure, standards-based, and production-proven in over 60 million cars.

So why am I going on about this? Because this week, at TU-Automotive Detroit, QNX is showcasing the full breadth of its automotive technology. Visitors to our booth will see demonstrations of ADAS, instrument clusters, infotainment, acoustics, smartphone integration, V2X, remote SIM management — the list goes on. Highlights include the latest QNX technology concept vehicle, which boasts a voice-controlled instrument cluster (man, I’d love one of those) and acoustics technology that allows a driver to talk to back-seat passengers without having to raise his voice or turn around — even if the car is driving at highway speeds. How cool is that?

That’s me, in the driver’s seat of an SUV, speaking to my colleague Tina, who is sitting in the back row. Thanks to
QNX acoustics technology, she can hear me clearly, even though I am speaking normally and looking straight ahead.

New platform for instrument clusters
Of course, we can’t show up at a major auto event without bringing something new for developers. And so, today, we are unveiling the latest addition to our portfolio of automotive safety products, the QNX Platform for Instrument Clusters.

QNX is already a proven player in the digital cluster market. Since 2009, our OS technology has been powering clusters in brands like Alfa Romeo, Audi, Corvette, Jaguar, and Range Rover. (Check out my recent post for a retrospective on QNX-powered clusters.) The new platform builds on this experience, enabling QNX to offer a comprehensive solution for cluster developers, which includes:

• The QNX OS for Safety, an ISO 26262-certified OS and toolchain that supports all the automotive safety integrity levels, from ASIL A to D, required for clusters and other critical systems
• A 2D/3D graphics framework based on the OpenGL standard and set to be certified to the ISO 26262 functional safety standard
• A software framework that protects safety-critical cluster functions from interference by other software components, enabling greater reliability and easier system-level certification
• A reference implementation, with source code, that gives developers a jumpstart on building fully digital instrument clusters

To get the full story, check out this morning’s press release.

The digital instrument cluster in the QNX concept vehicle, which is based on a Toyota Highlander. QNX has just
unveiled a new platform that allows instrument clusters with ISO 26262 safety requirements to leverage the
full power of accelerated 2D/3D graphics.

50 million systems, you say?
Hands-free systems may be common, but delivering a high-quality hands-free experience can be notoriously difficult. Cars are noisy beasts, and the cacophony created by tires, fans, vents, and open windows can play havoc with any system that has to process voice signals.

What to do? Well, for over 50 million infotainment and telematics systems, automakers have solved the problem with QNX acoustics technology. QNX acoustics offers patented algorithms for echo cancellation, noise reduction, and other technologies to ensure crisp, clear voice communications, even in the harsh sonic environment of the car. In fact, it has become so popular that, on average, it ships in an automotive system every 2.5 seconds. (So, can you do the math and tell me how many systems that adds up to each month?)

Did I mention? The QNX acoustics portfolio does far more than process voice signals. For instance, it includes the QNX Acoustics Management Platform, which offers unified management of all acoustics in the car, enabling customers to reduce the cost, complexity, and time-to-production of audio signal-processing systems. For more details, read this morning’s press release.

What do Taylor Swift’s legs and QNX Acoustics have in common?

By Megan Alink, Marketing Communications Director for Automotive

OK, so at first blush, nothing. Let me explain.

It starts with a number. A really big number. Think “40 million” — because I recently learned that that’s how many units of our QNX Acoustics for Voice product have shipped to date. Wow!

QNX Acoustics for Voice is a complete signal processing software solution for automotive voice communications, based on production-proven acoustics technology. It’s designed specifically to meet the acoustics challenges unique to the in-car environment, sets a new benchmark in hands-free quality, and, very importantly, supports the rigorous requirements of smartphone connectivity. Check out the product page for more information.

Obviously 40 million is a number worth talking about, so what’s the first thing that any marketing writer worth her salt does? She looks for an analogy to help put this impressive number into context. Number of steps it takes to go around the world? Population of California? Google comes in handy in such situations and eventually, it delivered the perfect informational nugget: Taylor Swift’s legs are reportedly insured for $40 million. What does this have to do with automotive acoustics? Well, clearly Ms. Swift’s legs are critical to her success as an entertainer, and, as anyone in the business of sound and noise knows, our acoustics engineers couldn’t make their magic — and achieve 40 million units sold — without their finely honed hearing. The conclusion is obvious. We must insure their ears for $40 million as well. All in favour?

Congratulations to everyone who has played a role in putting this ground breaking technology into the hands (and ears) of our customers, and many thanks to those customers for helping QNX achieve this amazing milestone.

With thanks to Phil Hetherington and Len Layton for the idea…

Long time, no see: Catching up with the QNX CAR Platform

By Megan Alink, Director of Marketing Communications for Automotive

It’s a fact — a person simply can’t be in two places at one time. I can’t, you can’t, and the demo team at QNX can’t (especially when they’re brainstorming exciting showcase projects for 2016… but that’s another blog. Note to self.) So what’s a QNX-loving, software-admiring, car aficionado to do when he or she has lost touch and wants to see the latest on the QNX CAR Platform for Infotainment? Video, my friends.

One of the latest additions to our QNX Cam YouTube channel is an update to a video made just over two and a half years ago, in which my colleague, Sheridan Ethier, took viewers on a feature-by-feature walkthrough of the QNX CAR Platform. Now, Sheridan’s back for another tour, so sit back and enjoy a good, old-fashioned catch-up with what’s been going on with our flagship automotive product (with time references, just in case you’re in a bit of a hurry).

Sheridan Ethier hits the road in the QNX reference vehicle based on a modified Jeep Wrangler, running the latest QNX CAR Platform for Infotainment.

We kick things off with a look at one of the most popular elements of an infotainment system — multimedia. Starting around the 01:30 mark, Sheridan shows how the QNX CAR Platform supports a variety of music formats and media sources, from the system’s own multimedia player to a brought-in device. And when your passenger is agitating to switch from the CCR playlist on your MP3 device to Meghan Trainor on her USB music collection, the platform’s fast detection and sync time means you’ll barely miss a head-bob.

The QNX CAR Platform’s native multimedia player — the “juke box” — is just one of many options for enjoying your music.

About five minutes in, we take a look at how the QNX CAR Platform implements voice recognition. Whether you’re seeking out a hot latté, navigating to the nearest airport, or calling a co-worker to say you’ll be a few minutes late, the QNX CAR Platform lets you do what you want to do while doing what you need to do — keeping your hands on the wheel and your eyes on the road. Don’t miss a look at concurrency (previously discussed here by Paul Leroux) during this segment, when Sheridan runs the results of his voice commands (multimedia, navigation, and a hands-free call) smoothly at the same time.

Using voice recognition, users can navigate to a destination by address or point of interest description (such as an airport).

At eight minutes, Sheridan tells us about one of the best examples of the flexibility of the QNX CAR Platform — its support for application environments, including native C/C++, Qt, HTML5, and APK for running Android applications. The platform’s audio management capability makes a cameo appearance when Sheridan switches between the native multimedia player and the Pandora HTML5 app.

Pandora is just one of the HTML5 applications supported by the QNX CAR Platform.

As Sheridan tells us (at approximately 12:00), the ability to project smartphone screens and applications into the vehicle is an important trend in automotive. With technologies like MirrorLink, users can access nearly all of the applications available on their smartphone right from the head unit.

Projection technologies like MirrorLink allow automakers to select which applications will be delivered to the vehicle’s head unit from the user’s connected smartphone. 

Finally, we take a look at two interesting features that differentiate the QNX CAR Platform — last mode persistence (e.g. when the song you were listening to when you turned the car off starts up at the same point when you turn the car back on) and fastboot (which, in the case of QNX CAR, can bring your backup camera to life in 0.8 seconds, far less than the NHTSA-mandated 2 seconds). These features work hand-in-hand to ensure a safer, more enjoyable, more responsive driving experience.

Fastboot in 0.8 seconds means that when you’re ready to reverse, your car is ready to show you the way.

Interested in learning more about the QNX CAR Platform for Infotainment? Check out Paul Leroux’s blog on the architecture of this sophisticated piece of software. To see QNX CAR in action, read Tina Jeffrey’s blog, in which she talks about how the platform was implemented in the reimagined QNX reference vehicle for CES 2015.

Check out the video here:

Beyond the dashboard: discover how QNX touches your everyday life

QNX technology is in cars — lots of them. But it’s also in everything from planes and trains to smart phones, smart buildings, and smart vacuum cleaners. If you're interested, I happen to have an infographic handy...

I was a lost and lonely soul. Friends would cut phone calls short, strangers would move away from me on the bus, and acquaintances at cocktail parties would excuse themselves, promising to come right back — they never came back. I was in denial for a long time, but slowly and painfully, I came to the realization that I had to take ownership of this problem. Because it was my fault.

To by specific, it was my motor mouth. Whenever someone asked what I did for a living, I’d say I worked for QNX. That, of course, wasn’t a problem. But when they asked what QNX did, I would hold forth on microkernel OS architectures, user-space device drivers, resource manager frameworks, and graphical composition managers, not to mention asynchronous messaging, priority inheritance, and time partitioning. After all, who doesn't want to learn more about time partitioning?

Well, as I subsequently learned, there’s a time and place for everything. And while my passion about QNX technology was well-placed, my timing was lousy. People weren’t asking for a deep dive; they just wanted to understand QNX’s role in the scheme of things.

As it turns out, QNX plays a huge role, and in very many things. I’ve been working at QNX Software Systems for 25 years, and I am still gobsmacked by the sheer variety of uses that QNX technology is put to. I'm especially impressed by the crossover effect. For instance, what we learn in nuclear plants helps us offer a better OS for safety systems in cars. And what we learn in smartphones makes us a better platform supplier for companies building infotainment systems.

All of which to say, the next time someone asks me what QNX does, I will avoid the deep dive and show them this infographic instead. Of course, if they subsequently ask *how* QNX does all this, I will have a well-practiced answer. :-)

Did I mention? You can download a high-res JPEG of this infographic from our Flickr account and a PDF version from the QNX website.



Stay tuned for 2015 CES, where we will introduce even more ways QNX can make a difference, especially in how people design and drive cars.

And lest I forget, special thanks to my colleague Varghese at BlackBerry India for conceiving this infographic, and for the QNX employees who provided their invaluable input.

Attending SAE Convergence? Here’s why you should visit booth 513

Cars and beer don’t mix. But discussing cars while having a beer? Now you’re talking. If you’re attending SAE Convergence next week, you owe it to yourself to register for our “Spirits And Eats” event at 7:00 pm Tuesday. It’s the perfect occasion to kick back and enjoy the company of people who, like yourself, are passionate about cars and car electronics. And it isn’t a bad networking opportunity either — you’ll meet folks from a variety of automakers, Tier 1s, and technology suppliers in a relaxed, convivial atmosphere.

But you know what? It isn’t just about the beer. Or the company. It’s also about the Benz. Our digitally modded Mercedes-Benz CLA45 AMG, to be exact. It’s the latest QNX technology concept car, and it’s the perfect vehicle (pun fully intended) for demonstrating how QNX technology can enable next-generation infotainment systems. Highlights include:

• A multi-modal user experience that blends touch, voice, and physical controls
• A secure application environment for Android, HTML5, and OpenGL ES
• Smartphone connectivity options for projecting smartphone apps onto the head unit
• A dynamically reconfigurable digital instrument cluster that displays turn-by-turn directions, notifications of incoming phone calls, and video from front and rear cameras
• Multimedia framework for playback of content from USB sticks, DLNA devices, etc.
• Full-band stereo calling — think phone calls with CD quality audio
• Engine sound enhancement that synchronizes synthesized engine sounds with engine RPM

Here, for example, is the digital cluster:



And here is a closeup of the head unit:



And here’s a shot of the cluster and head unit together:



As for the engine sound enhancement and high-quality hands-free audio, I can’t reproduce these here — you’ll have come see the car and experience them first hand. (Yup, that's an invite.)

If you like what you see, and are interested in what you can hear, visit us at booth #513. And if you'd like to schedule a demo or reserve some time with a QNX representative in advance, we can accommodate that, too. Just send us an email.

The summer road trip of 2017 – Part II

Lynn Gayowski

Our series looking at how in-car technologies will transform your summer road trip continues with part II. 2017 is around the corner, and between now and then, automakers will introduce a bevy of new features that will make for a safer and more enjoyable summer road trip. In our first part, we looked at your road trip soundtrack, navigation, and mobile device connectivity. This week, we look at safety, acoustics, and autonomous cars as we cruise to the last exit for this blog series.

Staying safe
By 2017, we likely won’t have developed the technology to shrink your mechanic down to a size that allows you to perch one on your dashboard like a bobble-head, but many cars will have a “virtual mechanic.” This application will let you check lights, fluids, tire pressure and other system vitals, all through your center stack, digital instrument cluster, or phone – as seen below. The idea of a safety speedometer is hardly new in concept (see the Plymouth safety speedometer from 1939), but its modern implementation in the cars of 2017 in the form of vision systems performing road sign detection might just mean fewer speeding tickets on your road trip, especially as you cruise through unfamiliar areas. 

Staying in touch
Sometimes you want to take a road trip to get away from the world, but sometimes you still want (or need) to stay connected. Whether it’s phone calls, texts, or emails, all of this information will continue to be seamlessly integrated into your car in 2017. Less fumbling, fewer distractions.

And low-quality, stilted speakerphone calls will be a thing of the past with the emerging crop of acoustic technologies. Driving alone on a stretch of road and miss having your loved ones close by? Advanced duplex technology will make it seem as though the person on the other end of your phone conversation is sitting right beside you in the passenger’s seat.  

Another cool development? You won’t have to struggle to use voice recognition technologies because of your noisy in-car cabin (that’s right, serenely quiet cabins will no longer be exclusive to luxury cars). Vehicles will continue to evolve to meet the strictest CAFÉ and emissions standards, while the negative acoustic side-effects from less damping materials will be countered using software to remove unwanted engine sound. And your engine in 2017 might really sound like purring (or growling, if that’s your preference), as signature sounds are enabled by engine sound enhancement software. So not only will you not feel crazy for talking to your car, you’ll also be less frustrated as you do so cruising down the interstate. 

Beyond 2017: Look ma, no hands!
While it won’t happen quite as soon as 2017, autonomous cars will hit the roads in the relatively near future, forever changing the dynamic of the road trip. Will road trips be more accessible for the elderly and others who can’t physically drive long distances? Will the new meaning of "cruise control" make the road trip more or less enjoyable? All of these considerations are up for discussion. One thing is certain: many of the advanced safety systems of today and 2017 are precursors to cars that could drive themselves. One such example of what the future of autonomous driving will look like is the University of Parma’s DEEVA autonomous car project being developed by the Artificial Vision and Intelligent Systems Laboratory (VisLab).  

How is in-car technology playing a role in your current summer road trip? How do you want it to improve your future road trips? Stay tuned to our QNX_Auto Twitter account and Facebook page for weekly discussions throughout the rest of the summer about 2017 has in store for your road trip.

A cool (and connected) cluster

"The more we get connected,
Connected, connected,
The more we get connected,
The happier we’ll be."

Okay, I'll admit it, that's a little over the top. But even if connectivity can't make you happy, it can still breathe a great deal of enjoyment and productivity into your life. And when you build connectivity into devices that have previously stood alone, you open the door to all kinds of exciting possibilities. Case in point: the new digital instrument cluster for the QNX technology concept car.

Here's the cluster at a glance — click to see a bigger version:



Admit it: you'd love to wrap your hands around that steering wheel. I know I would. The Mercedes CLA45 is a sweet ride, and it inspired the QNX concept team to pull out all the stops when designing the new cluster with our partner Rightware, a specialist in UI tools for cars.

Four-point check
Okay, let's hop in and take a closer look. But before we put the car in gear, did your driving instructor ever tell you to do a four-point check? You know, where you make sure your lights, brakes, and other systems are working properly? You do remember to do that, don't you? The cluster makes the task a little easier by checking lights, tire pressures, fluids, and the HVAC system automatically:



Ease off the pedal, buddy
Time to put the car in gear. But before we do, let me tell you about the Plymouth safety speedometer. Designed to curb speeding, it alerted the driver whenever he or she leaned too hard on the gas. In theory, it was a great idea. In practice, it wasn't. You see, the year was 1939. And given the limitations of 1939 technology, the Plymouth safety speedometer couldn't take driving conditions or the local speed limit into account. So the speedometer always displayed warnings at the same speeds, no matter what the speed limit.

Connectivity to the rescue! Some modern navigation systems include information on local speed limits. By connecting the digital instrumental cluster to the navigation system in the car's head unit, the concept team was able to pull this information and display it in real time on the cluster, creating a modern (and much more useful) equivalent of Plymouth's 1939 invention.

Look at the image below. You'll see the local speed limit surrounded by a thick red circle, alerting the driver that they are breaking the limit — the fulfillment of an idea that has been 75 years in the making. Mind you, this isn't the only information that the cluster pulls from the head unit. It can also display turn-by-turn directions, trip information, album art, and other content normally relegated to the center display:



Should you answer?
Oh, hold on, the cluster is alerting us to an incoming call. You can ignore it, or you can answer by pushing a button on the steering wheel. And because this is the QNX technology concept car, it's no ordinary phone call. The car is equipped with QNX Acoustics for Voice, which supports Wideband Plus speech to deliver almost four times the bandwidth of a standard narrowband call. Translation: The person on the far end of call sounds like they're sitting right next to you.



Looking back
Okay, it's been a great drive, but time to head home. And in this case, home is the QNX garage. The garage doors are pretty narrow, and you need to back in carefully, so it's great to know that the cluster also provides a convenient window for the car's rear-view camera:



Meanwhile, in the real world...
Don't make the mistake of thinking this is a Buck Rogers scenario. Because the same combination of QNX and Rightware technology is already powering innovative systems like the Audi virtual cockpit. If you haven't yet seen the Audi system in action, check it out:

Crisper, clearer in-car communication — Roger that

Tina Jeffrey

Over the years, Telematics Detroit has become a premier venue for showing off advancements in automotive infotainment, telematics, apps, cloud connectivity, silicon, and more. If the breadth of QNX technology being demonstrated at the show this week is any indication, the event won’t disappoint. Among the highlights is our next-generation acoustics processing middleware — QNX Acoustics for Voice 3.0 — which has been architected to deliver the highest-quality audio for hands-free and speech recognition systems, enabling the ultimate acoustics experience in the car.

What is QNX Acoustics for Voice?
QNX Acoustics for Voice 3.0 is the successor to the QNX Aviage Acoustics Processing Suite 2.0. The new product includes a set of libraries — standard and premium — that offer automakers ultimate flexibility for voice processing in the harsh audio environment of the car.

The standard library provides a full-featured solution for implementing narrowband and wideband hands-free communications, operating at 8 kHz and 16kHz sample rates, respectively. It also includes innovative new features for performing echo cancellation, noise reduction, adaptive equalization, and automatic gain control. Perhaps the most valuable feature, especially for systems constrained by limited CPU cycles, is the high efficiency mode, which can process wideband and higher-bandwidth speech with substantially less CPU load. The net result: more processing headroom for other tasks.

The premium library includes all the standard library functionality, plus support for Wideband Plus, which expands the frequency range of transmitted speech to 50 Hz - 11 kHz, at a 24kHz sample rate. The introduction of Wideband Plus fulfills the higher voice quality and low noise requirements demanded by the latest smartphone connectivity protocols for telephony, VoIP services, and speech recognition. Let me recap with a table:

Supported capabilities	Standard library	Premium library
Narrowband audio: 300 – 3400Hz (8kHz sample rate)	✔	✔
Wideband audio: 50-7000Hz (16kHz sample rate)	✔	✔
Wideband Plus audio: 50Hz – 11kHz (24kHz sample rate)		✔
High efficiency mode	✔  (Wideband only)	✔
VOIP requirements for new smartphone connectivity protocols		✔
Cloud-based speech recognition requirements for new smartphone connectivity protocols		✔

---

Why is high-quality speech important in the car?
Simply put, it improves the user experience and can benefit passenger safety. Also, new smartphone connectivity protocols require it. Let’s examine two use cases: hands-free voice calling, and speech recognition.

In a voice call, processing a larger bandwidth of speech and eliminating echo and noise from various sources, including wind, road, vents, fans, and tires, dramatically increases speech intelligibility — and the more intelligible the speech, the more natural the flow of conversation. Also, clearer speech has less impact on the driver’s cognitive load, enabling the driver to pay more attention to the task at hand: driving.

Speech recognition systems are becoming a primary way to manage apps and services in the car. Voice commands can initiate phone calls, select media for playback, search for points of interest (POI), and choose a destination.

Technological advancements in pre-processing voice input to remove noise and disturbances helps speech recognizers detect commands more reliably, thereby achieving higher recognition accuracy. Early speech recognition systems, by comparison, were unintuitive and performed poorly. Drivers became so frustrated that they stopped using these systems and resorted to picking up their smartphones, completely eliminating the safety benefits of speech recognition.

QNX Acoustics for Voice 3.0 is a comprehensive automotive voice solution that includes industry-leading echo cancellation, noise reduction, adaptive equalization and automatic gain control.

If you happen to be at Telematics Update in Novi Michigan this week, be sure to drop by our booth to sit in our latest concept car — a specially modified Mercedes-Benz CLA45 AMG — and experience our acoustics technologies first hand.