Connect with us

Biz & IT

Fleksy’s AI keyboard is getting a store to put mini apps at chatters’ fingertips

Published

on

Remember Fleksy? The customizable Android keyboard app has a new trick up its sleeve: It’s adding a store where users can find and add lightweight third party apps to enhance their typing experience.

Right now it’s launched a taster, preloading a selection of ‘mini apps’ into the keyboard — some from very familiar brand names, some a little less so — so users can start to see how it works.

The first in-keyboard apps are Yelp (local services search); Skyscanner (flight search); Giphy (animated Gif search); GifNote (music Gifs; launching for U.S. users only for rights reasons); Vlipsy (reaction video clips); and Emogi (stickers) — with “many more” branded apps slated as coming in the next few months.

They’re not saying exactly what other brands are coming but there are plenty of familiar logos to be spotted in their press materials — from Spotify to Uber to JustEat to Tripadvisor to PayPal and more…

The full keyboard store itself — which will let users find and add and/or delete apps — will be launching at the end of this month.

The latest version of the Fleksy app can be downloaded for free via the Play Store.

Mini apps made for messaging

The core idea for these mini apps (aka Fleksyapps) is to offer lightweight additions designed to serve the messaging use case.

Say, for example, you’re chatting about where to eat and a friend suggests sushi. The Yelp Fleksyapp might pop up a contextual suggestion for a nearby Japanese restaurant that can be shared directly into the conversation — thereby saving time by doing away with the need for someone to cut out of the chat, switch apps, find some relevant info and cut and paste it back into the chat.

Fleksyapps are intended to be helpful shortcuts that keep the conversation flowing. They also of course put brands back into the conversation.

“We couldn’t be more excited to bring the power of the world’s popular songs with GIFs, videos and photos to the new Fleksyapps platform,” says Gifnote co-founder, John vanSuchtelen, in a supporting statement.

Fleksy’s mini apps appear above the Qwerty keyboard — in much the same space as a next-word prediction. The user can scroll through the app stack (each a tiny branded circle until tapped on to expand) and choose one to interact with. It’s similar to the micro apps lodged in Apple’s iMessage but on Android where iMessage isn’t… The team also plans for Fleksy to support a much wider range of branded apps — hence the Fleksyapps store.

In-keyboard apps is not a new concept for the dev team behind Fleksy; an earlier keyboard app of theirs (called ThingThing) offered micro apps they built themselves as a tool to extend its utility.

But now they’re hoping to garner backing and buy in from third party brands excited about the exposure and reach they could gain by being where users spend the most device time: The keyboard.

“Think of it a bit like the iMessage equivalent but on Android across any app. Or the WeChat mini program but inside the keyboard, available everywhere — not only in one app,” CEO Olivier Plante tells TechCrunch. “That’s a problem of messaging apps these days. All of them are verticals but the keyboard is horizontal. So that’s the benefit for those brands. And the user will have the ability to move them around, add some, to remove some, to explore, to discover.”

“The brands that want to join our platform they have the option of being preloaded by default. The analogy is that by default on the home screen of a phone you are by default in our keyboard. And moving forward you’ll be able to have a membership — you’re becoming a ‘brand member’ of the Fleksyapps platform, and you can have your brand inside the keyboard,” he adds.

The first clutch of Fleksyapps were developed jointly, with the team working with the brands in question. But Plante says they’re planning to launch a tool in future so brands will be able to put together their own apps — in as little as just a few hours.

“We’re opening this array of functionalities and there’s a lot of verticals possible,” he continues. “In the future months we will embed new capabilities for the platform — new type of apps. You can think about professional apps, or cloud apps. Accessing your files from different types of clouds. You have the weather vertical. You have ecommerce vertical. You have so many verticals.

“What you have on the app store today will be reflected into the Fleksyappstore. But really with the focus of messaging and being useful in messaging. So it’s not the full app that we want to bring in — it’s really the core functionality of this app.”

The Yelp Fleksyapp, for example, only includes the ability to see nearby places and search for and share places. So it’s intentionally stripped down. “The core benefit for the brand is it gives them the ability to extend their reach,” says Plante. “We don’t want to compete with the app, per se, we just want to bring these types of app providers inside the messenger on Android across any app.”

On the user side, the main advantage he touts is “it’s really, really fast — fleshing that out to: “It’s very lightweight, it’s very, very fast and we want to become the fastest access to content across any app.”

Users of Fleksyapps don’t need to have the full app installed because the keyboard plugs directly into the API of each branded service. So they get core functionality in bite-sized form without a requirement to download the full app. (Of course they can if they wish.)

So Plante also notes the approach has benefits vis-a-vis data consumption — which could be an advantage in emerging markets where smartphone users’ choices may be hard-ruled by the costs of data and/or connectivity limits.

“For those types of users it gives them an ability to access content but in a very light way — where the app itself, loading the app, loading all the content inside the app can be megabits. In Fleksy you’re talking about kilobits,” he says.

Privacy-sensitive next app suggestions

While baking a bunch of third party apps into a keyboard might sound like a privacy nightmare, the dev team behind Fleksy have been careful to make sure users remain in control.

To wit: Also on board is an AI keyboard assistant (called Fleksynext) — aka “a neural deep learning engine” — which Plante says can detect the context, intention and sentiment of conversations in order to offer “very useful” app suggestions as the chat flows.

The idea is the AI supports the substance of the chat by offering useful functionality from whatever pick and mix of apps are available. Plante refers to these AI-powered ‘next app’ suggestions as “pops”.

And — crucially, from a privacy point of view — the Fleksynext suggestion engine operates locally, on device.

That means no conversation data is sent out of the keyboard. Indeed, Plante says nothing the user types in the keyboard itself is shared with brands (including suggestions that pop up but get ignored). So there’s no risk — as with some other keyboard apps — of users being continually strip-mined for personal data to profile them as they type.

That said, if the user chooses to interact with a Fleksyapp (or its suggestive pop) they are then interacting with a third party’s API. So the usual tracking caveats apply.

“We interact with the web so there’s tracking everywhere,” admits Plante. “But, per se, there’s not specific sensitive data that is shared suddenly with someone. It is not related with the service itself — with the Fleksy app.”

The key point is that the keyboard user gets to choose which apps they want to use and which they don’t. So they can choose which third parties they want to share their plans and intentions with and which they don’t.

“We’re not interesting in making this an advertising platform where the advertiser decides everything,” emphasizes Plante. “We want this to be really close to the user. So the user decides. My intentions. My sentiment. What I type decides. And that is really our goal. The user is able to power it. He can tap on the suggestion or ignore it. And then if he taps on it it’s a very good quality conversion because the user really wants to access restaurants nearby or explore flights for escaping his daily routine… or transfer money. That could be another use-case for instance.”

They won’t be selling brands a guaranteed number of conversions, either.

That’s clearly very important because — to win over users — Fleksynext suggestions will need to feel telepathically useful, rather than irritating, misfired nag. Though the risk of that seems low given how Fleksy users can customize the keyboard apps to only see stuff that’s useful to them.

“In a sense we’re starting reshape a bit how advertising is seen by putting the user in the center,” suggests Plante. “And giving them a useful means of accessing content. This is the original vision and we’ve been very loyal to that — and we think it can reshape the landscape.”

“When you look into five years from now, the smartphone we have will be really, really powerful — so why process things in the cloud? When you can process things on the phone. That’s what we are betting on: Processing everything on the phone,” he adds.

When the full store launches users will be able to add and delete (any) apps — included preloads. So they will be in the driving seat. (We asked Plante to a confirm the user will be able to delete all apps, including any pre-loadeds and he said yes. So if you take him at his word Fleksy will not be cutting any deals with OEMs or carriers to indelibly preload certain Fleksyapps. Or, to put it another way, crapware baked into the keyboard is most definitely not plan.)

Depending on what other Fleksyapps launch in future a Fleksy keyboard user could choose to add, for example, a search service like DuckDuckGo or France’s Qwant to power a pro-privacy alternative to using Google search in the keyboard. Or they could choose Google.

Again the point is the choice is theirs.

Scaling a keyboard into a platform

The idea of keyboard-as-platform offers at least the possibility of reintroducing the choice and variety of smartphone app stores back before the cynical tricks of attention-harvesting tech giants used their network effects and platform power to throttle the app economy.

The Android keyboard space was also a fertile experiment ground in years past. But it’s now dominated by Google’s Gboard and Microsoft-acquired Swiftkey. Which makes Fleksy the plucky upstart gunning to scale an independent alternative that’s not owned by big tech and is open to any third party that wants to join its mini apps party.

“It will be Bing search for Swiftkey, it will be Google search for Gboard, it will be Google Music, it will be YouTube. But on our side we can have YouTube, we can also have… other services that exist for video. The same way with pictures and the same way for file-sharing and drive. So you have Google Drive but you have Dropbox, you have OneDrive, there’s a lot of services in the cloud. And we want to be the platform that has them all, basically,” says Plante.

The original founding team of the Fleksy keyboard was acqui-hired by Pinterest back in 2016, leaving the keyboard app itself to languish with minimal updates. Then two years ago Barcelona-based keyboard app maker, ThingThing, stepped in to take over development.

Plante confirms it’s since fully acquired the Fleksy keyboard technology itself — providing a solid foundation for the keyboard-as-platform business it’s now hoping to scale with the launch of Fleksyapps.

Talking of scale, he tells us the startup is in the process of raising a multi-million Series A — aiming to close this summer. (ThingThing last took in $800,000 via equity crowdfunding last fall.)

The team’s investor pitch is the keyboard offers perhaps the only viable conduit left on mobile to reset the playing field for brands by offering a route to cut through tech giant walled gardens and get where users are spending most of their time and attention: i.e. typing and sharing stuff with their friends in private one-to-one and group chats.

That means the keyboard-as-platform has the potential to get brands of all stripes back in front of users — by embedding innovative, entertaining and helpful bite-sized utility where it can prove its worth and amass social currency on the dominant messaging platforms people use.

The next step for the rebooted Fleksy team is of course building scale by acquiring users for a keyboard which, as of half a year ago, only had around 1M active users from pure downloads.

Its strategy on this front is to target Android device makers to preload Fleksy as the default keyboard.

ThingThing’s business model is a revenue share on any suggestions the keyboard converts, which it argues represent valuable leads for brands — given the level of contextual intention. It is also intending to charge brands that want to be preloaded on the Fleksy keyboard by default.

Again, though, a revenue share model requires substantial scale to work. Not least because brands will need to see evidence of scale to buy into the Fleksyapps’ vision.

Plante isn’t disclosing active users of the Fleksy keyboard right now. But says he’s confident they’re on track to hit 30M-35M active users this year — on account of around ten deals he says are in the pipeline with device makers to preload Fleksy’s keyboard. (Palm was an early example, as we reported last year.)

The carrot for OEMs to join the Fleksyapps party is they’re cutting them in on the revenue share from user interactions with branded keyboard apps — playing to device makers’ needs to find ways to boost famously tight hardware margins.

“The fact that the keyboard can monetize and provide value to the phone brands — this is really massive for them,” argues Plante. “The phone brands can expect revenue flowing in their bank account because we give the brands distribution and the handset manufacturer will make money and we will make money.”

It’s a smart approach, and one that’s essentially only possible because Google’s own Gboard keyboard doesn’t come preloaded on the majority of Android devices. (Exceptions include its own Pixel brand devices.) So — unusually for a core phone app on Android — there’s a bit of an open door where the keyboard sits, instead of the usual preloaded Google wares. And that’s an opportunity.

Markets wise, ThingThing is targeting OEMs in all global regions with its Fleksy pitch — barring China (which Plante readily admits it too complex for a small startup to sensibly try jumping at).

Apps vs tech giants

In its stamping ground of Europe there are warm regulatory winds blowing too: An European Commission antitrust intervention last year saw Google hit with a $5BN fine over anti-competitive practices attached to its Android platform — forcing the company to change local licensing terms.

That antirust decision means mobile makers finally have the chance to unbundle Google apps from devices they sell in the region.

Which translates into growing opportunities for OEMs to rethink their Android strategies. Even as Google remains under pressure not to get in the way by force feeding any more of its wares.

Really, a key component of this shift is that device makers are being told to think, to look around and see what else is out there. For the first time there looks to be a viable chance to profit off of Android without having to preload everything Google wants.

“For us it’s a super good sign,” says Plante of the Commission decision. “Every monopolistic situation is a problem. And the market needs to be fragmented. Because if not we’re just going to lose innovation. And right now Europe — and I see good progress for the US as well — are trying to dismantle the imposed power of those big guys. For the simple evolution of human being and technology and the future of us.”

“I think good things can happen,” he adds. “We’re in talks with handset manufacturers who are coming into Europe and they want to be the most respectful of the market. And with us they have this reassurance that you have a good partner that ensures there’s a revenue stream, there’s a business model behind it, there’s really a strong use-case for users.

“We can finally be where we always wanted to be: A choice, an alternative. But having Google imposing its way since start — and making sure that all the direct competition of Google is just a side, I think governments have now seen the problem. And we’re a winner of course because we’re a keyboard.”

But what about iOS? Plante says the team has plans to bring what they’re building with Fleksy to Apple’s mobile platform too, in time. But for now they’re fully focusing efforts on Android — to push for scale and execute on their vision of staking their claim to be the independent keyboard platform.

Apple has supported third party keyboards on iOS for years. Unfortunately, though, the experience isn’t great — with a flaky toggle to switch away from the default Apple keyboard, combined with heavy system warnings about the risks of using third party keyboards.

Meanwhile the default iOS keyboard ‘just works’ — and users have loads of extra features baked by default into Apple’s native messaging app, iMessage.

Clearly alternative keyboards have found it all but impossible to build any kind of scale in that iOS pincer.

“iOS is coming later because we need to focus on these distribution deals and we need to focus on the brands coming into the platform. And that’s why iOS right now we’re really focusing for later. What we can say is it will come later,” says Plante, adding: “Apple limits a lot keyboards. You can see it with other keyboard companies. It’s the same. The update cycle for iOS keyboard is really, really, really slow.”

Plus, of course, Fleksy being preloaded as a default keyboard on — the team hopes — millions of Android devices is a much more scalable proposition vs just being another downloadable app languishing invisibly on the side lines of another tech giant’s platform.

Source link

Source link

Continue Reading
Click to comment

Leave a Reply

Your email address will not be published. Required fields are marked *

Biz & IT

Biden’s executive order limits government’s use of commercial spyware

Published

on

Getty Images

President Joe Biden on Monday signed an executive order barring many uses by the federal government of commercial spyware, which has been increasingly used by other countries in recent years to surveil dissidents, journalists, and politicians.

The signing of the executive order came as administration officials told journalists that roughly 50 US government personnel in at least 10 countries had been infected or targeted by such spyware, a larger number than previously known. The officials didn’t elaborate.

Commercial spyware is sold by a host of companies, with the best known being NSO Group of Israel. The company sells a hacking tool known as Pegasus that can surreptitiously compromise both iPhones and Android devices using “clickless” exploits, meaning they require no user interaction. By sending a text or ringing the device, Pegasus can install spying software that steals contacts, messages, geo locations, and more, even when the text or call isn’t answered. Other companies selling commercial spyware include Cytrox, Candiru, and Paragon.
While NSO describes Pegasus as a “lawful intercept” tool that’s sold only to legitimate law-enforcement agencies to investigate crime and terrorism. Mexico, India, Saudi Arabia, the United Arab Emerates, Morocco, and other countries have been caught deploying it against political dissidents, journalists, and other citizens that aren’t accused of any crimes. In November 2021, the Biden administration restricted the export, re-export, and in-country transfer of products from NSO and three other companies in Israel, Russia, and Singapore.

Monday’s executive order goes further by barring federal agencies, including those engaged in law enforcement, defense, or intelligence activities, from “operationally using” commercial spyware.

“The proliferation of commercial spyware poses distinct and growing counterintelligence and security risks to the United States, including to the safety and security of US Government personnel and their families,” a fact sheet published by the White House said. “US Government personnel overseas have been targeted by commercial spyware, and untrustworthy commercial vendors and tools can present significant risks to the security and integrity of US Government information and information systems.”

White House officials aren’t naming the specific spyware that’s barred, but using the term commercial spyware strongly implies it includes tools sold by NSO, Cytrox, Candiru, and others. Criteria for tools falling under the order include if:

  • they’re abused by a foreign government in an attempt to access the device of a US citizen
  • a foreign actor deploys them against activists or dissidents in an attempt to intimidate or curb dissent or opposition or squelch expressions of free speech
  • they’re supplied to governments for which there are credible reports that they engage in systematic acts of political repression.

The officials declined to say if US law enforcement and intelligence agencies currently use commercial spyware. Last year, the FBI confirmed a New York Times report that the bureau had bought NSO Group’s Pegasus tool for product testing and evaluation but said they weren’t used for operational purposes or to support any investigation. The US Drug Enforcement Agency, the NYT has also reported, deployed a surveillance tool called Graphite for use in counternarcotics operations.

Continue Reading

Biz & IT

The power of AI compels you to believe this fake image of Pope in a puffy coat

Published

on

Enlarge / An AI-generated photo of Pope Francis wearing a puffy white coat that went viral on social media.

Over the weekend, an AI-generated image of Pope Francis wearing a puffy white coat went viral on Twitter, and apparently many people believed it was a real image. Since then, the puffy pontiff has inspired commentary on the deceptive nature of AI-generated images, which are now nearly photorealistic.

The pope image, created using Midjourney v5 (an AI image synthesis model), first appeared in a tweet by a user named Leon (@skyferrori) on Saturday and quickly began circulating as part of other meme tweets featuring similar images as well, including one that humorously speculates about a pope “lifestyle brand.”

Not long after, Twitter attached a reader-added context warning to the tweet that reads, “This is an AI-generated image of Pope Francis. It is not a genuine photo.

As noted in our piece on last week’s AI-generated Donald Trump arrest photos, Twitter guidelines state that users “may not deceptively share synthetic or manipulated media that are likely to cause harm.” Although in this case, the line between harm and parody might be a fuzzy one.

How do we know the image is fake? Aside from a Reddit post containing alternative images of the Pope from the person that likely made it, The Verge breaks down the evidence fairly well in a piece analyzing the impact of the false image. For example, if you zoom in on details, you’ll see telltale signs of image synthesis in warped details like the pope’s crucifix necklace, the crooked shadow of his glasses, and whatever he is carrying in his hand (a cup?).

But still, upon a quick glance, the false photo (“fauxto”?) looks fairly realistic. And as The Verge notes, a stylish image of Pope Francis plays into our beliefs about the papacy, which often involves wild non-fake imagery—although Pope Francis is known for his “humble” outfits.

A Midjourney journey

The image service used to create the fake photo, Midjourney, debuted last year. Along with DALL-E and Stable Diffusion, it’s one of three major image synthesis models that have become popular online. All three allow users to generate novel images using only text descriptions called “prompts.”

Our experiments with
Enlarge / Our experiments with “Pope Francis in a 1990s white puffer jacket,” created using Midjourney v5.

Midjourney

In this case, the prompt used to create the puffy pope photo might have been as simple as “Pope Francis in a puffy white coat” because Midjourney has made huge leaps in photorealism recently, rendering complex scenes full of details from relatively simple prompts.

What this almost effortless capability to fake photos means for the future of media is still uncertain, but as we’ve speculated before, due to image synthesis, we may never be able to believe what we see online again.

Continue Reading

Biz & IT

Hobbyist builds ChatGPT client for MS-DOS

Published

on

Enlarge / A photo of an IBM PC 5155 portable computer running a ChatGPT client written by Yeo Kheng Meng.

On Sunday, Singapore-based retrocomputing enthusiast Yeo Kheng Meng released a ChatGPT client for MS-DOS that can run on a 4.77 MHz IBM PC from 1981, providing a unique way to converse with the popular OpenAI language model.

Vintage computer development projects come naturally to Yeo, who created a Slack client for Windows 3.1 back in 2019. “I thought to try something different this time and develop for an even older platform as a challenge,” he writes on his blog. In this case, he turned his attention to MS-DOS, a text-only operating system first released in 1981, and ChatGPT, an AI-powered large language model (LLM) released by OpenAI in November.

As a conversational AI model, ChatGPT draws on knowledge scraped from the Internet to answer questions and generate text. Thanks to an API that launched his month, anyone with the programming chops can interface ChatGPT with their own custom application.

Thanks to his new app, which can run on MS-DOS, Yeo can use a vintage IBM PC-compatible computer to chat with ChatGPT over the Internet. It’s a similar back-and-forth conversation as the traditional ChatGPT web interface, albeit as a text-only, full-screen application running on the antique machine.

Development challenges

A photo of an IBM PC 5155 computer running a ChatGPT client written by Yeo Kheng Meng.
Enlarge / A photo of an IBM PC 5155 computer running a ChatGPT client written by Yeo Kheng Meng.

MS-DOS posed a particularly challenging platform for a ChatGPT client, lacking native networking abilities. In addition, Yeo targeted a computer with very limited processing power: a 1984 IBM 5155 Portable PC, which includes an Intel 8088 4.77 MHz CPU, 640KB conventional memory, CGA ISA graphics, and MS-DOS 6.22.

To create the client, Yeo used Open Watcom C/C++, a modern compiler running on Windows 11 that can target 16-bit DOS platforms. For testing purposes, he used a VirtualBox virtual machine running DOS 6.22 to streamline the development process, then he transferred the compiled binary to the target IBM DOS PC for testing.

To handle networking on the IBM PC, Yeo needed to weave his way through several layers. First, Yeo utilized a “Packet Driver API” standard invented in 1983. He integrated the open source MTCP library by Michael B. Brutman into the application to communicate with the Packet Driver, enabling networking capabilities for the client.

For the ChatGPT API, Yeo used OpenAI’s Chat Completion API, constructing the POST request (and parsing the JSON-formatted response) manually in C.

However, Yeo hit a major snag: the ChatGPT APIs require encrypted HTTPS connections. Since there are no native HTTPS libraries for MS-DOS, Yeo had to create an HTTP-to-HTTPS proxy that can run on a modern computer and translate the requests and responses between the MS-DOS client and ChatGPT’s secure API, acting as a transparent middleman in the communication process.

Yeo says that reading and writing input to the console presented another challenge due to the single-threaded nature of DOS applications. He devised a method to check and receive keypresses without pausing the program using the MTCP page and online samples as a reference.

In the end, the client works better than Yeo expected, and he looks forward to more retro challenges in the future: “After experiencing this, I will definitely be writing more retro-software in future,” he writes in a blog post that describes his development process in more detail.

Yeo has released his code (called “doschgpt”) on GitHub if others want to run it themselves—or perhaps improve or extend the code in the future. With a little creativity, the latest tech in AI language models need not be limited to cutting-edge machines.

Continue Reading

Trending