Keynote

Vision Pro

• 2,000 Apps created for Vision Pro
• Vision OS - 4 months since launch, today announcing Vision OS 2
• Vision OS 2
  • Photos
  • Quick acecess Apps, Control Center
  • Mac Virtual Display - wrap around display up to 2 4Ks
  • Travel Mode Train Support
  • New APIs for enterprise
• Apple Vision Pro going to more countries!

iOS 18

• Home Screen
  • customization
    • App Icon - placement and dark look for icons
      • new tinting options
• Control Center
  • swipe to new controls
  • Controls Gallery
  • more extensible - devs can add controls from their apps
  • Controls API
  • Controls available from lockscreen
  • Action Button can invoke these new controls
• Privacy
  • hide apps from others
    • Hidden Apps Folder
  • new ways to share info with apps - e.g. - Contacts
  • Accessories - new privacy controls
• Messages
  • Tap Backs - any emoji or sticker
  • Text Effects
  • Messages via satellite
    • SMS supported too!
• Mail
  • categorization
• Maps
  • topographic maps
  • all US National Parks
• Wallet
  • journey to replace physical wallet
  • ‘Tap to Cash’
• Journal
  • Goals - writing streaks, stats
  • Search
• Gaming
  • Game Mode
• Photos
  • biggest redesign ever
  • Categorization
  • Trips
  • Customizable to prioritize topics
• Reminders in Calendar!!

#

Audio and Home Apple TV

Airpods

• Voice Isolation

Apple Tv

• Insight

  • Sherlock - CallSheet

• Subtitles
  • turn on when you mute or skip back

Apple Watch

• Watch OS 11
  • Training Load
    • data, insights and recommendations
    • effort rating
  • Fitness App
  • Vitals App
    • daily health metrics
    • new way to quickly view you health metrics

iPad OS 18

• Home Screen Personalization, Control Center Customization
• Apple Pencil Updates
• Floating Tab Bar
  • Customizable
• Calculator
  • Math Notes
• Notes - Smart Script refines handwriting as you go

macOS

• Sequoia
• Continuity
  • iPhone mirroring!
• iPhone Notifications
  • interactable
• Tile windows by dragging
• Keychain - Passwords App
  • Sherlocks 1Password
• Safari
  • Highlights - driven by Machine Learning
  • Redesigned Reader
    • Table of Contents, Summary
  • Viewer

Apple Intelligence

Powerful, Intuitive, Itegrated,

Personal Intelligence and its the next big step for Apple

Intelligence that understands you

Capabilities

• understand and create Languages, Images, Actions and Personal Context
• Large Language Models built in!
• Images
• Personal Context
• Powerful Privacy at the core
  • On device processing
• Private Cloud Compute
  • A brand-new standard for privacy in AI

This really sounds like Apple has been working on this for a long time. On Device and Private Cloud compute is a big deal!

Experiences

• Siri
  • introduced 13 years
  • taking major step forward
  • this is big
• App Intents API
  • Personal Context Awareness + Actions
    • figuring out timing for things
• Smart Reply
• Browse Inbox
  • Summaries
• Genmoji
• Image Playground
  • with an API
• Image Wand
  • rough sketch to polished image
• Photo Editing
• Notes - record and transcribe
• Phone App Recording
• Apple Intelligence available for free!
• ChatGPT 4o
  • access for free
  • subscribers access account

Developers

• SDKs
• Image Playground
• Writing Tools
• Xcode - generative code

AI for the rest of us

Platform State of the Union

New Apis

1. Double Tap API
2. Add your app to Control Center
3. Text translate API
4. Interactive widgets on watchOS
5. Swift 6
6. Game Porting Toolkit 2
7. Volumetric APIs
8. AccessoryWidgetGroup API
9. AccessorySetupKit
10. AdAttributionKit
11. Enterprise APIs
12. TabletopKit
13. iPad Tab Bar APls
14. Sensitive Content Analysis on visionOS
15. Live Activities on watchOS
16. Suggested widgets on watchOS
17. Customize your app icon tinting
18. Zoom Transitions
19. Personalized Spatial Audio for game developers
20. Document Launch View
21. Multi-core CPU APIs
22. State of Mind API
23. Object Tracking APIs
24. Sidebar APls
25. Spatial Audio APls for games

• CoreML Tools
• Swift Transformers Package
• macOS training models
• Machine Learning Research at Apple
• Xcode
  • Code Completion
    • specifically trained for Swift and Apple SDKs
    • runs locally on Mac, works offline
  • Swift Assist
• Swiftlang on Gitub
• Swift 6
  • Data-race safety - compile time data-race safety
  • 
• SwiftUI
  • Image Playground app and Passwords app written in SwiftUI
  • Previews
    • reuses build assets
    • easier to use state in previews
  • Customizations
    • new text animations
  • Interoperability
    • Appkit and UIKit
    • Shared gesture

  • SwiftUI is ready to build any interface you want, using less code and better code

• SwiftData
  • Index
  • Unique
  • @Previewable macro
  • Custom data stores
  • Data Store History

• RealityKit

Swift Testing

• https://developer.apple.com/documentation/Testing
• Paramaterized Testing
• cross-platform

• Open source

Synchronization

• https://developer.apple.com/documentation/Synchronization

Tabletop Kit

• https://developer.apple.com/documentation/TabletopKit

• Swift Guide
• Machine Leanring & AI guide

Sessions to Watch

• Whats new in Swift
• Go small with Embedded Swift
• Bring your machine learning and AI models to Apple Silicon