Connect with us

Gadgets

Krisp reduces noise on calls using machine learning, and it’s coming to Windows soon – TechCrunch

Published

on

If your luck is anything like mine, as soon as you jump on an important call, someone decides it’s a great time to blow some leaves off the sidewalk outside your window. 2Hz’s Krisp is a new desktop app that uses machine learning to subtract background noise like that, or crowds, or even crying kids — while keeping your voice intact. It’s already out for Macs and it’s coming to Windows soon.

I met the creators of Krisp, including 2Hz co-founder Davit Baghdasaryan, earlier this year at UC Berkeley’s Skydeck accelerator, where they demonstrated their then-prototype tech.

The tech involved is complex, but the idea is simple: If you create a machine learning system that understands what the human voice sounds like, on average, then it can listen to an audio signal and select only that part of it, cutting out a great deal of background noise.

Baghdasaryan, formerly of Twilio, originally wanted to create something that would run on mobile networks, so T-Mobile or whoever could tout built-in noise cancellation. This platform approach proved too slow, however, so they decided to go straight to consumers.

“Traction with customers was slow, and this was a problem for a young startup,” Baghdasaryan said in an email later. However, people were loving the idea of ‘muting noise,’ so we decided to switch all our focus and build a user-facing product.”

That was around the time I talked with them in person, incidentally, and just six months later they had released on Mac.

It’s simple: You run the app, and it modifies both the outgoing and incoming audio signals, with the normal noisy signal going in one end and a clean, voice-focused one coming out the other. Everything happens on-device and with very short latency (around 15 milliseconds), so there’s no cloud involved and nothing is ever sent to any server or even stored locally. The team is working on having the software adapt and learn on the fly, but it’s not implemented yet.

Another benefit of this approach is it doesn’t need any special tweaking to work with, say, Skype instead of Webex. Because it works at the level of the OS’s sound processing, whatever app you use just hears the Krisp-modified signal as if it were clean out of your mic.

They launched on Mac because they felt the early-adopter type was more likely to be on Apple’s platform, and the bet seems to have paid off. But a Windows version is coming soon — the exact date isn’t set, but expect it either late this month or early January. (We’ll let you know when it’s live.)

It should be more or less identical to the Mac version, but there will be a special gaming-focused one. Gamers, Baghdasaryan pointed out, are much more likely to have GPUs to run Krisp on, and also have a real need for clear communication (as a PUBG player I can speak to the annoyance of an open mic and clacky keys). So there will likely be a few power-user features specific to gamers, but it’s not set in stone yet.

You may wonder, as I did, why they weren’t going after chip manufacturers, perhaps to include Krisp as a tech built into a phone or computer’s audio processor.

In person, they suggested that this ultimately was also too slow and restrictive. Meanwhile, they saw that there was no real competition in the software space, which is massively easier to enter.

“All current noise cancellation solutions require multiple microphones and a special form factor where the mouth must be close to one of the mics. We have no such requirement,” Baghdasaryan explained. “We can do it with single-mic or operate on an audio stream coming from the network. This makes it possible to run the software in any environment you want (edge or network) and any direction (inbound or outbound).”

If you’re curious about the technical side of things — how it was done with one mic, or at low latency, and so on — there’s a nice explanation Baghdasaryan wrote for the Nvidia blog a little while back.

Furthermore, a proliferation of AI-focused chips that Krisp can run on easily means easy entry to the mobile and embedded space. “We have already successfully ported our DNN to NVIDIA GPUs, Intel CPU/GNA, and ARM. Qualcomm is in the pipeline,” noted Baghdasaryan.

To pursue this work the company has raised a total of $2 million so far: $500K from Skydeck as well as friends and family for a pre-seed round, then a $1.5 M round led by Sierra Ventures and Shanda Group.

Expect the Windows release later this winter, and if you’re already a user, expect a few new features to come your way in the same time scale. You can download Krisp for free here.

Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published.

Gadgets

Google loses two execs: one for Messaging and Workspace, another for Payments

Published

on

Google had a pair of high-ranking executives leave this week. The first was Bill Ready, Google’s “President of Commerce, Payments & Next Billion Users,” who left to become CEO of Pinterest. The second big departure is Javier Soltero, who was vice president and GM of Google Workspace, Google’s paid business app, and was the leader of Google Messaging. Both executives made big changes to Google in their nearly three-year stints at the company. Now that they are leaving, it’s unclear what the future of their respective products holds.

Ready was only at Google for two-and-a-half years, where his highest-profile move was presiding over the disastrous rollout of a significant Google Pay revamp. The new Google Pay app was spearheaded by Ready’s payments team, led by another recently ousted executive, Caesar Sengupta. The Google Pay revamp brought an app originally developed for India to the US, where the requirement for phone number-based identity came with a huge list of downgrades: The Google Pay website had to be stripped of payment functionality, the app no longer supported multiple accounts, and you couldn’t be logged in to multiple devices.

The rollout of the new app was also clumsy. Slowly, over a month or two, users were kicked out of the old Google Pay and had to transition to a new app. The new identity system wasn’t backward compatible with the old Google Pay, though, which meant users still on the old app couldn’t send money to users on the new app.

According to Pulse network (a wing of Discover card) Google Pay has 3 percent of the entire US NFC market. Keep in mind Google entered this market years before Apple.

According to Pulse network (a wing of Discover card) Google Pay has 3 percent of the entire US NFC market. Keep in mind Google entered this market years before Apple.

The new Google Pay was announced one year into Ready’s tenure at Google and launched in March 2021. The app initially came with big plans for expansion, including a wild announcement of Google-branded bank accounts. Sengupta left Google one month after the US launch of the new Google Pay, which triggered an “exodus” of employees, according to Insider. The report said, “Dozens of employees and executives” left the payments team after Sengupta’s departure, with one employee saying there was “frustration” the new Google Pay “wasn’t growing at the rate we wanted it to.”

What happened afterward seems like a complete scrapping of the original “New Google Pay” game plan. Google generally launches a product in the US first and then slowly rolls it out to the rest of the world, but after the initial poor reception, the new Google Pay never saw a wide rollout outside of the US. Google canceled its heavily promoted plans for a Google bank account, even though, according to the Wall Street Journal, the company already had 400,000 curious users sign up for the public waitlist.

Ready appointed a new leader of Payments this January, a move Bloomberg described as a “reset” of Google’s payments strategy. Ready also made headlines at the time by saying, “Crypto is something we pay a lot of attention to,” though no Google product has emerged.

Four months later, at Google I/O 2022, another revamp of Google Pay was announced, re-branding the product to “Google Wallet.” That’s right, after a big revamp of Google’s payment app in 2021, there’s now another new revamp in 2022. Ready is now leaving five months after appointing a new Payments lead and setting these plans in motion, but he won’t be around for the launch of Google Wallet. Between the departure of old Payments lead Sengupta, Sengupta’s boss, Ready, and “dozens” of team members, it sure seems like the payments team ended up cleaning house.

This nightmare of a map has the US with Google Pay and Google Wallet co-existing, while the rest of the world gets a cleaner solution of one payment app: Wallet.

This nightmare of a map has the US with Google Pay and Google Wallet co-existing, while the rest of the world gets a cleaner solution of one payment app: Wallet.

Google

At the heart of Google’s payments turbulence is probably the fact that most estimates put Google Pay at 3-4 percent of the US NFC payments market, which is way behind Apple’s nearly 92 percent market share. It’s an embarrassing loss considering Google was a pioneer in NFC payments and entered the market three years before Apple.

A big part of Google’s payment problems is this kind of instability, with Google’s payment app running through four different brands in 10 years (Google Wallet, then Android Pay, then Google Pay, now Google Wallet again). It still doesn’t seem like the company has arrived at a great solution with the new Google Wallet. The current plan—which could change once Ready’s replacement is hired—is for Google Wallet and Google Pay to co-exist in the US. In the rest of the world, there will be one payment app, Wallet, which sounds like a clean, reasonable offering. In the US and Singapore, though, Google doesn’t want to kill the widely panned new Google Pay app, so Google Wallet and Google Pay will be available. Why? If Wallet is rolling out to the rest of the world, the codebase clearly has the full payment feature set, why not just roll it out everywhere?

Google is still searching for a VP to replace Bill Ready, but the interim Payments president will be longtime Googler Nick Fox. Fox was previously front and center in the Google tech landscape as the head of Google messaging when the company produced Google Allo. Allo was Google’s main messaging app from 2016-2018, lasting about 576 days on the market. Since Allo, Fox has been running Google Search.

Continue Reading

Gadgets

Forget smart glasses, this smart contact lens prototype has a new vision for AR 

Published

on

Enlarge / Smart contact lenses don’t work quite this easily yet. (credit: Getty)

Since 2015, a California-based company called Mojo Vision has been developing smart contact lenses. Like smart glasses, the idea is to put helpful AR graphics in front of your eyes to help accomplish daily tasks. Now, a functioning prototype brings us closer to seeing a final product.

In a blog post this week, Drew Perkins, the CEO of Mojo Vision, said he was the first to have an “on-eye demonstration of a feature-complete augmented reality smart contact lens.” In an interview with CNET, he said he’s been wearing only one contact at a time for hour-long durations. Eventually, Mojo Vision would like users to be able to wear two Mojo Lens simultaneously and create 3D visual overlays, the publication said.

According to his blog, the CEO could see a compass through the contact and an on-screen teleprompter with a quote written on it. He also recalled viewing a green, monochromatic image of Albert Einstein to CNET.

Read 10 remaining paragraphs | Comments

Continue Reading

Gadgets

Some Macs are getting fewer updates than they used to. Here’s why it’s a problem

Published

on

Aurich Lawson

When macOS Ventura was announced earlier this month, its system requirements were considerably stricter than those for macOS Monterey, which was released just eight months ago as of this writing. Ventura requires a Mac made in 2017 or later, dropping support for a wide range of Monterey-supported Mac models released between 2013 and 2016.

This certainly seems more aggressive than new macOS releases from just a few years ago, where system requirements would tighten roughly every other year or so. But how bad is it, really? Is a Mac purchased in 2016 getting fewer updates than one bought in 2012 or 2008 or 1999? And if so, is there an explanation beyond Apple’s desire for more users to move to shiny new Apple Silicon Macs?

Using data from Apple’s website and EveryMac.com, we pulled together information on more than two decades of Mac releases—almost everything Apple has released between the original iMac in late 1998 and the last Intel Macs in 2020. We recorded when each model was released, when Apple stopped selling each model, the last officially supported macOS release for each system, and the dates when those versions of macOS received their last point updates (i.e. 10.4.11, 11.6) and their last regular security patches. (I’ve made some notes on how I chose to streamline and organize the data, which I’ve put at the end of this article).

The end result is a spreadsheet full of dozens of Macs, with multiple metrics for determining how long each one received official software support from Apple. These methods included measuring the amount of time between when each model was discontinued and when it stopped receiving updates, which is particularly relevant for models like the 2013 Mac Pro, 2014 Mac mini, and 2015 MacBook Air that were sold for multiple years after they were first introduced.

Continue Reading

Trending