Monday, February 19, 2024

Apple has an Xcode plan for genAI - and it's just the beginning

 


In the wake of Microsoft's release of the GitHub Copilot tool, Apple may soon follow suit with a new version of Xcode that includes generative AI (genAI) capabilities designed to help developers write code.

 

The feature is expected to be able to generate code in response to natural language commands. This should be helpful for Apple developers, especially Apple's Xcode Pro should be able to validate code, check for errors, and more.

 

Developers, developers, state-sponsored hackers

 

Even the most security-conscious developers may be able to use this tool, as it seems Apple will develop it to be as private as possible; That means your code and your requests are not stored on a cloud server somewhere.

 

[Get ready for Generative AI with testing and clear guidelines]

It's also interesting to consider how this software might work alongside some of the innovative genAI technologies that Apple and others are working on. Think about how virtual worlds can be created for gaming apps and how these virtual spaces can be used within software-based experiences. (There was speculation last summer that building such a large language model (LLM)-based virtual world was already on Apple's radar.)

 

Hopefully, of course, this move won't inspire state-sponsored hackers to (probably) use these automated tools to pull off their hacks, such as the rogue NSO group, as Microsoft has already confirmed that some groups are working with Copilot.

 

GenAI in the Spotlight

 

The latest report also suggests that Apple may choose to improve Spotlight search with GenAI. Spotlight is an on-device search available on every device that lets you search through your digital "content."

 

Making Spotlight more contextually aware, fluid, and responsive through generative AI is potentially powerful because it means everything you can do with your device – including actions dependent on different apps – can be made possible by describing what you need.

 

It's like taking AppleScript or Shortcut and turning the volume up to 11, although the development teams in Cupertino aren't sure yet if they'll be ready this year.

 

Cupertino is rising

 

The accelerating pace of well-timed reports from within Apple's AI team represents two key approaches: Apple is making clear that it won't be lagging in the AI arms race while sending a message to its audience about what's coming.

 

We've seen a lot of this activity this week as well, but it's now clear that where it makes sense, Apple's teams are weaving generative AI into strategic domains through the company's platform ecosystem.

 

Bloomberg reports that Apple's software vice president, Craig Federighi, has urged employees to develop as many new AI features as possible for Apple's devices, even though the company is developing more complex articulations that may not be ready for some time yet.

 

The latter refers to a road map of gene deployment across the Apple ecosystem, perhaps somewhat defined by hardware, software, and ethical constraints.

 

Everything real is a machine

 

Likewise, the continued acceleration of Apple's efforts speaks volumes and promises more. Think back to the launch of the original iPhone and all you had was music, browsing, and communication; Now, you'll be able to add automatic creation of almost anything you can speak to the list. The potential ceiling remains unchanged.

 

Signing off, here are the most recent revelations regarding Apple's work around AI at the moment:

 

Apple has developed Keyframer, a tool that creates animations for 2D images.

Apple created MLLM-directed image editing to edit images using text commands.

The company unveiled technology last year that allows genAI models to run on edge devices like iPhones, requiring no servers.

Apple has the ML Explore machine learning framework for Silicon.

Apple Ferret helps optimize machine learning.

Apple has created a tool for creating avatars from videos.

Apple has published many research papers and made dozens of AI-related acquisitions in the past year, with more to come.

 

What is the secret that Apple has not revealed?

 

Keep in mind that, when considering an enterprise as secretive as Apple, many development projects have now been leaked or published, meaning a lot is going on at the company that we don't yet know about.

 

And now that the development of Vision 1 is complete (if such development is indeed complete), the company's software teams have a little more opportunity to find the domains where LLM intelligence can make the most difference in people's lives.

 

It's a work in progress, and the beginning of that effort is nowhere near the end.

No comments:

Post a Comment