Anthropic's latest development gives its Claude AI assistant the ability to control a PC, reportedly just like a person would. The feature, dubbed 'computer use,' entered public beta today. With computer use, Claude can be directed to execute tasks such as "looking at a screen, moving a cursor, clicking buttons, and typing text," according to the company's announcement.
We've built an API that allows Claude to perceive and interact with computer interfaces.
This API enables Claude to translate prompts into computer commands. Developers can use it to automate repetitive tasks, conduct testing and QA, and perform open-ended research. pic.twitter.com/eK0UCGEozm
In theory, this could make the AI even more useful in automating repetitive computer tasks. However, a second blog post focused on computer use acknowledged that this application of Anthropic's AI models is still early in development and, to paraphrase, buggy as heck. The company said that in internal testing, Claude stopped in the middle of an assigned coding task and began opening images of Yellowstone National Park. While that is uncannily human behavior (who doesn't want to take a break to stare at natural beauty during the work day?), it's also a reminder that even the best AI models can have errors.
In addition to unveiling computer use, Anthropic also released an upgraded version of its Claude 3.5 Sonnet model alongside a brand new model called Claude 3.5 Haiku that will be released later in October. In August, Anthropic joined OpenAI in agreeing to share its work with the US AI Safety Institute.
This article originally appeared on Engadget at https://www.engadget.com/ai/anthropic-is-letting-claude-ai-control-your-pc-181500127.html?src=rss
If you’re a game developer or animator, chances are you frequent sites like the Unreal Engine Marketplace, Quixel, ArtStation Marketplace and Sketchfab Store. The days of buying assets from each of these stores separately are over, as Epic Games just launched Fab, its new marketplace merging all of the sites mentioned above.
While the Fab website is live, Unreal Engine 5 Editor users can also access it in the app directly when the update is live. Unreal Editor for Fortnite also has Fab integration, which is currently down for maintenance.
Fab’s content includes animations, VFX, environments, characters, plug-ins and much more. These assets may have either a Creative Commons license or Standard License; the latter comes in Personal and Professional tiers. Epic Games says that both tiers of the Fab Standard License allow assets to be used in any game engine you want. However, the Creative Commons license only allows assets to be used on Unreal Engine. 3D assets can also be viewed in real time before purchasing to ensure developers only get the products they need.
Epic Games
The entire Quixel Megascans library is available for free now until the end of this year, and the contents are free to use in all engines and creation tools. There are 17,000 assets from the original library, along with 10 packs accompanying Fab’s launch.
Epic Games also mentioned some future goals for Fab, including Roblox and Minecraft assets, access to MetaHumans and more. There will also be a portion of Fab’s Megascans content made free next year in the form of a starter pack.
This article originally appeared on Engadget at https://www.engadget.com/gaming/epic-games-launches-a-new-unified-game-development-assets-marketplace-fab-135335228.html?src=rss
Apple Pay debuted almost 10 years ago to the day, and Apple is marking the occasion by rolling out some features it revealed at WWDC. If you have iOS 18 or iPadOS 18 installed on your iPhone or iPad, you'll now be able to use the payment service on third-party browsers on those devices, as well as desktop computers. In the latter case, you'll be asked to scan a QR code with your iPhone or iPad to complete the payment. However, Apple says the feature is only available in select markets.
It'll be easier than ever to add supported cards to Apple Wallet on your iPhone. Thanks to the Tap to Provision feature, you can simply tap an eligible NFC-enabled card to the back of your phone, though you may have to enter the security code manually. Again, though, Tap to Provision isn't available everywhere.
Apple is bringing more third-party buy now, pay later (BNPL) services to Apple Pay. This starts with the ability to check out with Klarna in the US and UK. The company will add more installment payment options in the future, including Citi, Synchrony and eligible Apple Pay issuers via Fiserv in the US. Klarna will also be available as an option in Canada at a later date. Apple discontinued its own Pay Later option earlier this year and it added Affirm as a BNPL option in the US last month.
Meanwhile, US Apple Pay users can redeem rewards on eligible Discover credit cards at checkout. Support for rewards from other issuers and in more countries is on the way.
Update October 18, 8:48AM ET: This story previously indicated that Apple was starting to add third-party BNPL services with the integration of Klarna, but Affirm support was added last month.
This article originally appeared on Engadget at https://www.engadget.com/mobile/apple-pay-now-works-with-third-party-ios-and-desktop-browsers-163048055.html?src=rss
Seventeen years is an odd anniversary to call out. But at an event launching four new Kindles, Amazon’s head of devices and services Panos Panay reminded a group of media that “Kindle is 17 years in the making, almost to the day.” Panay added that the device is currently seeing its highest sales numbers, and that 20.8 billion pages are read each month on a Kindle. But people aren’t just reading on Kindles. Since the introduction of the Kindle Scribe in 2022, there has been even more development in e-paper writing tablets, with a notable recent product in the reMarkable Paper Pro. While that $580 device supports a color writing experience, Amazon’s Kindle Scribe still only works in black and white. But it might offer enough by way of software updates to make up for its monochrome manner.
Plus, being able to write on what’s already a popular ereader makes that book-like experience even more realistic, and the Kindle Scribe represents what Panay called the “fastest growing category” of Kindles. You could almost call it a 2-in-1, since it’s an ereader and writing tablet at once. “I have a lot of passion around 2-in-1s,” Panay said at his presentation, and he used that term repeatedly to describe the Kindle Scribe. I haven’t thought about it that way, but I was less worried about semantics and more about how the Kindle Scribe and its new features felt at a hand-on session yesterday.
I’m the sort of person that needs to physically write out something while I plan a project. Whether it’s lofty goals to get my life together or draft up a strategy for covering certain software releases at work, my hands grasp at the air for an imaginary pen and paper. For that reason, the Kindle Scribe and other writing tablets call out to me. I reviewed the original Kindle Scribe almost two years ago and since then Amazon has slowly expanded the feature set and made the device more useful.
With the original Scribe, Amazon got a lot of the basics right. The latency and smoothness of the writing experience were close to feeling like pen and paper, and the device felt sturdy and slick. The new Scribe felt very similar in that sense, with little noticeable difference in the way the stylus interacted with the screen, and I didn’t encounter any jarring lag in the brief time I had with it.
Where the Scribe left me wanting more was software, and that’s also the area Amazon appears to have focused on this year. Don’t get me wrong — it’s not like the company didn’t tweak the hardware. There are some refinements like new white borders, a smaller grip, different color options and an updated stylus with a soft-tip top that feels more like a conventional eraser.
Cherlynn Low for Engadget
But inside the device lie the more intriguing changes. Most significant in my opinion is the new Active Canvas. It directly addresses one of my biggest complaints in my review, which is that the writing experience within books and publications was a little wonky.
To quote myself, this was what I said in 2022: “You can also take down notes when you’re reading an e-book. But it’s not like you can scribble directly onto the words of your e-books. You can use the floating toolbox to create a sticky note, then draw within a designated rectangle. When you close the sticky note, a small symbol appears over the word it was attached to, but otherwise, your scribbles are hidden. No annotating in the margins here.”
All of that has changed with the new Kindle Scribe. When you’re in an e-book, you can now just start writing on the page, and a box will appear, containing your scribbles. You no longer need to first find the floating toolbox and select the sticky note tool. Just write. It’s so much simpler, and in the Kindle Scribe I played with it worked almost instantly. Not only is the box embedded within the text, with the book’s words rearranging and flowing to accommodate it, but you can also resize the rectangle to take up however much space you like. The rest of the page will reflow to make room as necessary. I was particularly impressed by how quickly this happened on the demo unit — it was more responsive than switching between notebooks on my existing Scribe.
Plus, the box containing your note will stay in place instead of being hidden and replaced by a small symbol. It’s clear that Amazon’s earlier implementation was a rudimentary workaround to allow people to write on fixed format media, whereas the new approach is more deeply integrated and thought out.
And unlike what I said two years ago, you can now annotate in a new collapsible margin. Tapping the top right corner brings up options to pull up the column, and you can choose from having it take up about a quarter of the width or spread out to about three quarters. Content in the margin will be scrollable, so you theoretically won’t run out of space.
Cherlynn Low for Engadget
Now, this isn’t a perfect replica of annotating on a real textbook, but it might be better since you won’t have to scrawl all around the borders or write upside down just to squeeze in your thoughts. I’m not sure yet, as I really need to spend more time with it to know, but I like that Amazon clearly has taken in feedback and thought about how to add these requested features.
The company also added the ability to use the Pen and directly highlight or underline within those books, and pretty much any Kindle title will support most of these features. They’d have to be content that allows for font resizing, to start, so things like PDFs, which are fixed, won’t work with the Active Canvas. Word documents are compatible as well.
I spend more time writing in blank notebooks than in actual books, and for those scenarios, Amazon is using generative AI in two new tools: Summarization and Refined Writing. The former is pretty straightforward. If you’ve handwritten 10 pages worth of brainstorming meeting notes, the system can scan all of it and collate just the highlights. You can have this be added as a page to the existing notebook as a summary, or save it as a separate document on its own.
Refined Writing, meanwhile, is like Apple’s Handwriting Assist on iPadOS 18 but on a larger scale. While Apple’s software feels like it’s about nipping and tucking stray words that are out of alignment, Amazon’s takes your entire handwritten page and converts it into text in a script-like font. This works best if you tend to write in a single column with clear indentations and paragraphs. I tend to draw random boxes all over the place for breakout thoughts, and the system will not perfectly replicate that. For example, a two-column shopping list I quickly drafted on a demo Scribe was merged into one, and the checkboxes I drew were interpreted as capital letter Ds that were inserted at the start of every bullet.
Amazon
It might not seem immediately useful, but if you’re the sort of person that’s shy about their handwriting, this could save you some shame. More importantly, it can make you writing more legible in case you need to share, say, your screenplay treatment with a production partner. Or if your scrawled shopping list just isn’t making sense to your partner. I also like that even after you’ve converted your notes into text, you can still erase them using the top of the pen and make edits. You’ll have to run Refined Writing again to regenerate a neatly formatted page. Oh, and I appreciate the flexibility you get here. You’ll have a few fonts and sizes to choose from, and can select the pages you want to reformat or have the entire book done up altogether.
None of the notebook features are destructive, meaning you’ll usually be able to retain your original written content and save the generated material as addendums. The AI work is done in the cloud, with your data being encrypted throughout the process. The Kindle Scribe also displays an animated page showing it’s busy with the generative AI task, which in my experience so far took at least 10 seconds. It might be different on the original Kindle Scribe, which will also be getting these software features either later this year or, in the case of the expandable margins, in early 2025 when it arrives on the new Kindle Scribe.
In its 17 years, the Kindle has done a lot to disrupt physical books, and since the introduction of the Scribe, it’s been poised to do the same for notebooks. As someone who’s relished being able to carry around the equivalent of a thousand books in a super thin device, the idea of replacing a bunch of notebooks with a Scribe is immensely intriguing. Amazon does find itself up against some stiff competition from reMarkable and Boox, but it has its sheer size and the power of its Kindle library in its favor. The Kindle Scribe will be available in December for a starting price of $400, and I hope to have a review unit in soon enough to see if I love or hate the new annotation and AI features.
This article originally appeared on Engadget at https://www.engadget.com/mobile/tablets/kindle-scribe-hands-on-you-can-scribble-on-your-books-130043335.html?src=rss
Google is rolling out a slew of updates for Pixel watches, smartphones and tablets. In many cases, their predecessors are also getting the new features, such as Night Sight for Instagram — available on all Pixel 6 or newer devices, including A-series phones. The tool allows you to take photos directly on Instagram without worrying about them coming out dark. This could be ideal if you're someone who likes taking photos at concerts or parties without worrying about a bright flash going off. Other updates available for Pixel 6 or newer devices include astrophotography through Night Sight and theft protection.
Now globally available, theft protection one of the most expansive updates and actually applies to all Android 10 or newer devices (Android 15 is out today) — not just Pixel. Then, later this year, Google will release Identity Check, a feature that requires biometric authentication to access actions like changing your PIN and disabling theft protection. The new feature includes tools like the AI-powered Theft Detection Lock, which uses on-device machine learning to detect possible attempts to steal your device and will automatically lock it if so. Additional features include Remote Lock, which lets you seal your device with just a verified phone number, and Offline Device Lock. You can watch a full overview of theft protection on Android's YouTube page.
Google released its latest lineup in August: the Pixel 9, Pixel 9 Pro XL and Pixel 9 Pro and some of its newest features are exclusive to it. Such is the case for a Gemini extension for screenshots, a tool that lets you "Hey Google" your way to the exact image you're looking for. For example, you can say, "Hey Google, use Screenshots to show to find the red shirt I saved." Plus, you can now use a waterproof case to capture improved images and videos under the sea.
Update October 16, 1:51PM ET: Google initially indicated that Pixel A-series devices would not have access to the Night Sight for Instagram feature. However, it later confirmed — via Android reporter Mishaal Rahman — that "Night Sight for Instagram is available on the Pixel 6 and later, including A-series."
This article originally appeared on Engadget at https://www.engadget.com/new-pixel-updates-include-ai-powered-theft-protection-160042706.html?src=rss
Robot vacuums across the country were hacked in the space of several days, according to reporting by ABC News. This allowed the attackers to not only control the robovacs, but use their speakers to hurl racial slurs and abusive comments at anyone nearby.
All of the affected robots were of the same make and model, the Chinese-made Ecovacs Deebot X2s. This particular robovac has developed a reputation for being easy to hack, thanks to a critical security flaw. ABC News, for instance, was able to get full control over one of the robots, including the camera.
One victim of this week’s hacks was a Minnesota lawyer named Daniel Swenson. He told ABC that he was watching TV when the robot started making weird noises, like “a broken-up radio signal or something.” Through the app, Swenson could tell that a stranger was accessing the live camera feed and the remote control feature.
He reset the password and rebooted the vacuum, but that’s when the weirdness really started. It immediately started moving again of its own accord and the speakers began emitting a human voice. This voice was yelling racist obscenities right in front of Swenson’s son.
"I got the impression it was a kid, maybe a teenager," said Swenson. "Maybe they were just jumping from device to device messing with families." Ultimately, he said it could have been worse, such as if the vacuum silently spied on his family for days on end.
Swenson’s device was hacked on May 24. That same day another Deebot X2s in Los Angeles began chasing around a dog. This vacuum’s speakers also shouted abusive comments. Five days later, a similar incident happened in El Paso. It remains unclear how many of the company’s devices have been hacked in total.
At the root of this issue is a security flaw that allows bad faith actors to bypass the required four-digit security PIN in order to gain control of the vacuum. This issue originally came to light in December 2023. The Bluetooth connector also has a flaw that allows for complete access from up to 300 feet away. However, the attacks occurred throughout the country, so the Bluetooth vulnerability is an unlikely culprit.
According to Gizmodo, the company has developed a patch to eliminate the aforementioned security flaw that’ll roll out sometime in November. We reached out to Ecovacs to get a confirmation on this.
This article originally appeared on Engadget at https://www.engadget.com/cybersecurity/hackers-are-making-robot-vacuums-randomly-yell-racial-slurs-184017187.html?src=rss
Alongside its new family of Arrow Lake desktop hardware, Intel today also gave us a few tidbits around its upcoming Arrow Lake H mobile chips for high performance laptops. First off, they're not expected to arrive until the first quarter of 2025 — but the slight wait might be worth it, as Intel says they will offer powerful new Xe GPUs with XMX. Thanks to that upgrade, the GPU alone will offer four times better AI workload processing than its previous chips, alongside double the ray tracing performance and twice as much cache (8MB L2).
Notably, though, these new chips will still lag behind the company's less powerful Lunar Lake processors when it comes to NPU and overall AI TOPS (tera operations per second) figures. Arrow Lake H's NPU will hit 13 TOPS, the new GPU will reach 77 and the CPU will offer 9 TOPS. Taken altogether, it'll offer up to 99 TOPS of performance. Lunar Lake, meanwhile, sports a 48 TOPS NPU and up to 120 TOPS of system-wide AI performance.
Intel
The difference makes sense when you consider what these chips are meant for. Lunar Lake is mostly geared towards ultraportables and slim workstations, while Arrow Lake H chips are targeted at demanding notebooks with desktop-like performance. While they can technically be called AI PCs, Arrow Lake H's low NPU performance doesn't meet the bar for Microsoft's Copilot+ badge (those require at least 40 TOPS NPUs). You'll be able to run basic AI features, like Windows Studio Effects in video chats, but not more complicated tasks like Recall.
Intel didn't have many other details to share about Arrow Lake H, but we'll likely hear more at CES 2025.
Intel
This article originally appeared on Engadget at https://www.engadget.com/computing/laptops/intels-upcoming-arrow-lake-h-laptop-chips-will-offer-beefier-gpus-for-ai-workloads-150021214.html?src=rss
Amazon said on Wednesday that it’s rolling out new online ordering methods for Prime members, including the ability to bundle standard orders and groceries in one same-day shipment. The company is also adding more combined Amazon / Whole Foods fulfillment centers and trialing a store where robots pack your Amazon orders while you shop for groceries.
The company’s bundling of same-day Amazon.com orders with groceries kicks off in the Phoenix area. Customers there can shop “tens of thousands of grocery items” (including fresh ones) alongside regular Amazon orders for things like AirPods or Lego sets. The items will be bundled in one order and arrive together in a user-selected, same-day or overnight delivery window.
The company plans to expand the combined same-day model to more areas after it tests and learns from the Phoenix trial.
Along similar lines, Amazon is expanding its product range in some Amazon Fresh fulfillment centers. The company is modifying 26 of them globally to add “the best of Whole Foods Market and household goods on Amazon.com.” Like the Phoenix-area trial, it aims to more efficiently combine orders from separate branches of the sprawling online store.
Finally, the company is trialing a Whole Foods Market of the future in Plymouth Meeting, Pennsylvania (about 19 miles from Philadelphia). The store will add an automated Amazon.com micro-fulfillment center to serve up household items (Amazon used the examples of Tide Pods and Pepsi) while you cruise the aisles, buying organic spinach and pita bread.
You’ll order on your phone, and robots will prepare them in the back-of-house while you shop. The app will include a countdown of estimated time remaining before it’s finished. The idea is for the micro-fulfillment center order to be complete by the time you check out: Take your phone to the counter, grab your Tide Pods and get hopping.
The service will launch at the Plymouth Meeting store in 2025. The video below shows a visualization of the futuristic Philly-area location in action.
This article originally appeared on Engadget at https://www.engadget.com/big-tech/amazon-will-start-offering-regular-and-grocery-items-in-a-single-same-day-order-184227542.html?src=rss
Contract employees of ride sharing apps and services aren’t known for having the steadiest or even sanest of pay rates. Lyft just announced some new earnings improvements for its drivers that will help cover their expenses when rides take longer than they should and show them how much they’ll earn before they pick up a fare.
Lyft announced the new driver earnings improvements on its official blog. The new earnings improvements aim to “tackle drivers’ biggest frustrations, and make it more rewarding” for Lyft drivers.
One of the biggest improvements affects how drivers are paid if they are stuck in traffic or go out of their way to help a rider. Lyft is implementing a new “5-minute-delay pay” structure that will increase a driver’s pay if any ride takes five minutes longer than expected. “Out-of-your-way pay” covers drivers who have to drive out of the normal coverage area only to turn around and drive all the way back without any fares.
Lyft is also implementing a new earnings dashboard on the mobile app for drivers. The new interface will also show drivers’ daily, weekly and yearly earnings and the estimated hourly rate for each ride “so drivers don’t have to make the mental calculation,” according to the post.
Drivers who drive electric vehicles for Lyft are also seeing some new benefits. EV drivers can choose only to receive rides that fall within their vehicle’s battery range and find nearby charging stations on the Lyft drivers app.
Of course, these new policies and changes won’t solve Lyft drivers’ problems overnight. It’ll take time to see if they make a dent (the good kind of dent).
This article originally appeared on Engadget at https://www.engadget.com/transportation/lyft-promises-upfront-hourly-rates-and-traffic-delay-pay-for-its-drivers-220142458.html?src=rss
In our review of the OnePlus 12, we said the smartphone's affordability was one of the best things about it. Now, thank's to Amazon's upcoming Prime Day sale, that's an even more compelling point. A 19 percent discount drops the price to $650 for the model with 12GB of RAM and 256GB of storage. That's a a new all-time low (it's gone for $700 a few times previously). The model with 16GB/512GB is also $150 off and down to $750.
Other than being a great value for a flagship phone, the OnePlus also has solid cameras that take sharp and clear images. Just note that the camera module is strikingly bulky and you'll see a watermark from Hasselblad (the camera company OnePlus partners with) unless you opt to remove it.
The battery life is another win. We measured a lifespan of over 26 hours in our video rundown test. And after just 10 minutes of wall charging, the phone got from 10 to 55 percent. It refilled to 37 percent in the same amount of time sitting on a OnePlus wireless charger, which is available separately for $50.
The design is pleasingly "retro" (if you can apply that term to an aesthetic that harkens back a mere five years) with the rounded corners and tapered edges of something like the Galaxy S10+. The OnePlus 12 also takes notes from the past when it comes to AI — in that it mostly forgoes the buzzy new tech in favor of basic (but solid) smartphone functionality.
The screen and processor are fully modern, however, with a super bright and crisp 120Hz screen and a Snapdragon 8 Gen 3 chip that we found to offer fluid performance, despite clocking in a tad low on some benchmarks.
Elsewhere, Amazon is also selling the OnePlus Open for $1,300, which is a $400 discount on the phone we named the more affordable pick for a flagship foldable. That's a price the Open has hit previously, as recently as last month.
Follow @EngadgetDeals on Twitter for the latest tech deals and buying advice, and stay tuned to Engadget.com for all of the best tech deals coming out of October Prime Day 2024.
This article originally appeared on Engadget at https://www.engadget.com/the-oneplus-12-smartphone-drops-to-a-record-low-of-650-for-prime-day-220729473.html?src=rss