• Creative Corner
  • Tips
  • Blog
11 February, 2019

Apple ARKit New Features & Format

9series | 0Comment(s)

ARKit

What is an ARKit?
AR – Augmented Reality. ARKit is Apple’s framework for AR apps and games. It is a developers tool that user don’t need to worry about. It is a development platform used by the developers of an iOS app development company.

Overview
The ARKit library was introduced by Apple in WWDC 2017. It allows the developers to build apps using the AR (Augmented Reality) technology.
~ AR apps allow us to view virtual objects in the real environment through the camera.
~ AR describes user experience that adds 2D or 3D elements to the live view from a device’s camera in a way that makes those elements appear to inhabit the real world.
~ For a 2D object, SpritKit Library is used. For 3D Objects, SceneKit is used.
~ With 2D AR, you can add overlays or signposts, which respond to geographic location or visual features in real-time or with 3D AR, you can visualize how a painting might look in the walls of your living room or on the walls of your without you having to leave your home.
~ At WWDC 2018, Apple released ARKit 2.0 with a slew of brands new APIs and features for Augmented Reality Development.
~ ARKit uses device’s motion sensors combined with visual information from the camera to track the real world. Some clever math uses this tracking data and maps specialties into the real 3D world to your 2D screen.

What’s new in ARKit 2?
ARKit has some new additions that have made it a lot better and fun to use. Developers have new options to add in their developments. Let’s take a look at the developments in ARKit2.

Realistic Rendering
The interpretation of augmented reality objects is already quite good. However, Apple has improved rendering. ARKit 2 unlocks the ability for museums or similar organizations to “scan” their exhibition and allow information panels to appear above the statue.

3D Object Detection and Tracking
ARKit 1.5 adds support for 2D image identification, letting you trigger an AR experience based on 2D images like posters, artwork or signs. ARKit 2 gave this support to offer full 2D image tracking, so you can include movable objects like product boxes or magazines into your AR experiences. ARKit 2 also adds the capability to identify familiar 3D objects like sculptures, toys or furniture.

Persistent Experiences
You can keep AR spaces and objects that are connected to the physical objects (like toys) or physical spaces (like classrooms), so you can choose up where you left off last time.

According to Apple’s description, a world map comprises of anchors, objects and other features that an ARKit uses to be aware of the space around the user. ARKit 2 brings the ability to endure these world maps, which opens the ability to yield these experiences with others or save them for use in the same application later.

Shared Experiences
Many users will be able to use their iOS devices to see the identical virtual environment, each from their own view. Apple is releasing a block-breaking multiplayer game as a code demand demo and Logo showed off a virtual play space where up to four players can interact with a merged virtual and real play space altogether.

USDZ Format
Apple worked with Pixar to create a new file format for augmented reality objects called USDZ. This will be supported by third-party apps including ones by AutoDesk, Adobe, Sketchfab and more. USDZ is a new file format used to display and share 3D content natively in iOS, with optimizations for storage and sharing. On iOS 12, a built-in app such as Safari, Messages, Mail, News and Notes can natively Quick Look USDZ files of virtual objects in 3D or AR.

Environment Texturing
Environment textures are cube-map textures that depict the view in all directions from a specific point in a scene. In 3D asset interpretation, environment textures are the basis for image-based lighting algorithms where the surface can practically reflect light from their surroundings. Arkit can generate environment textures during an AR session using camera imagery, allowing SceneKit or a custom rendering engine to provide realistic image based lighting for virtual objects in your AR experience.

When using augmented reality, it’s necessary to make objects combine with the environment around them. In the first version of ARKit, highlights such as ambient light detection tried to make the virtual object “fit in” with the scene. ARKit 2 allows the object to reveal the texture around them.

The ARKit apps will be using SceneKit for its interpretation. SceneKit is the native 3D rendering engine for iOS, with direct hooks into ARKit.

Requirement
There are a few requirements for using ARKit.
1. Processor
An A9 or later processor: Only the iPhone 6s and up, the 2017 iPhone and iPad Pros can run ARKit.
2. Space
You will need plenty of space. To play ARmageddon, you will need clear space so you can capture bugs without falling over your furniture.
3. Contrast
If your room has white tiles, furniture and walls, or maybe it is too dark, things won’t work too well; the camera requires a contrast in order to identify surfaces and distances of objects.

3D model format
3D Models are of the format DAE and SCN
We can create a customize 3D models using the free Blender Software. There are a few native formats available in SceneKit that we can use to load the 3D Model. The DAE format allows us to have multiple objects in the scene file, including cameras and lights as well as any geometry.

Sizing and Units
SceneKit makes use of meters as a unit of measurement for sizing and physics simulations. So when there is a mention of size, including the Scene Editor in Xcode, it is always in context to meters.

In Blender, you also need to ensure you’re working in meters. Blender’s default is a meter unit, but it’s always safer to check than deal with a giant or minuscule model in your scene.

Coordinate System
SceneKit operates in a “Y-up” system, meaning the Y-axis is pointing up, whereas Blender works with the Z-axis pointing up. We should have knowledge of this before exporting our scene and when loading it into SceneKit. Usually, this isn’t a problem, as the exporter normally takes care of the conversion. Depending on whether you’re using a custom exporter or are working in a different coordinate system, you may need to rotate the model inside of your modeling application.

How World Tracking Works
To create a correspondence between real and virtual spaces, ARKit uses a technique called visual-inertial odometry. This process combines information from the iOS device’s motion-sensing hardware with the computer vision analysis of the scene visible to the device’s camera. ARKit recognizes notable features in the scene image, tracks differences in the positions of those features across video frames, and compares that information with motion sensing data. The result is a high-precision model of the device’s position and motion.

World tracking also examines and interprets the contents of the scene. Use hit-testing techniques to find the real-world surfaces matching to a point in the camera image. If you enable the Plane Detection setting in your session configuration, ARKit identifies flat surfaces in the camera image and communicates their position and sizes. You can use hit-test results or identified planes to place or communicate with virtual content in your scene.

Conclusion
In this article, we have covered points about what’s new in ARKit, its Format, Coordinate system, etc. With these new formats and features, we can move our application to the Next Level of the current world environment. These features will benefit the developers of a Mobile app development company allowing them to advance their apps.

Happy Coding! and feel free to share your own experience on “[email protected]”.

Recent Posts

  • Easy Methods To Share Files From Host To Docker

  • 9series Inc - Clutch Year In Review 2021

  • A Quick Comparison of Docker vs. VM: Which DevOps Tool is Best?

  • Latest Update on Docker Paid Subscription for Big Enterprise

  • How to Become a Successful Travel Agent in New York

Categories

  • .Net MVC (3)
  • AI Solutions (2)
  • Amazon DynamoDB (1)
  • Android (24)
  • Android App Developers (2)
  • Android app development (7)
  • Angularjs Development (4)
  • Apple (25)
  • Artificial Intelligence (1)
  • Artificial Intelligence Solutions (3)
  • Beacon Technology (4)
  • Best Christmas Offer (2)
  • Blockchain Technology (2)
  • Cloud Service (2)
  • Clutch (1)
  • custom mobile app development services (4)
  • DevOps (1)
  • Digital Marketing (9)
  • Django (2)
  • Docker (11)
  • E-Learning Technology (3)
  • Ecommerce (1)
  • Events (4)
  • Flutter app development (1)
  • GDPR (1)
  • Google I/O (1)
  • Graphic Design (12)
  • html5 developers (2)
  • Human Resource (5)
  • Infographics (33)
  • iOS (21)
  • Laravel Development (2)
  • machine development companies in India (1)
  • Machine Learning (4)
  • Marketing (9)
  • mean stack development (1)
  • Microsoft (11)
  • Mobile App Design (3)
  • Mobile App Development (48)
  • Moodle Development (1)
  • next-generation technology (6)
  • Node.js (2)
  • Online Marketing (1)
  • Open Source (11)
  • open source Javascript framework (1)
  • Opening Ceremony (1)
  • Python (3)
  • Python Development (4)
  • Responsive Website Development (9)
  • SaaS App Development (2)
  • Search Engine Optimization (4)
  • Social Media Marketing (2)
  • Software Development Company (2)
  • Technology (44)
  • Testing (11)
  • Top Laravel Development (1)
  • Travel and Hospitality Technology Solution (4)
  • Typescript (1)
  • UI Design Company India (1)
  • UI Design Services (1)
  • UI/UX Design (10)
  • Uncategorized (11)
  • VueJS (3)
  • Web Application Development (8)
  • Website Design (2)
  • Website Development Company (7)

Archives

  • February 2022  (2)
  • January 2022  (1)
  • October 2021  (2)
  • September 2021  (3)
  • August 2021  (3)
  • July 2021  (1)
  • June 2021  (4)
  • May 2021  (1)
  • April 2021  (2)
  • March 2021  (1)
  • February 2021  (3)
  • January 2021  (1)
  • December 2020  (1)
  • November 2020  (2)
  • October 2020  (2)
  • September 2020  (1)
  • August 2020  (3)
  • July 2020  (2)
  • June 2020  (4)
  • May 2020  (3)
  • April 2020  (4)
  • March 2020  (4)
  • February 2020  (3)
  • January 2020  (2)
  • December 2019  (6)
  • November 2019  (1)
  • October 2019  (4)
  • September 2019  (4)
  • August 2019  (5)
  • July 2019  (3)
  • June 2019  (5)
  • May 2019  (2)
  • April 2019  (2)
  • February 2019  (5)
  • January 2019  (2)
  • December 2018  (2)
  • November 2018  (3)
  • October 2018  (6)
  • September 2018  (6)
  • August 2018  (7)
  • July 2018  (5)
  • June 2018  (5)
  • May 2018  (6)
  • April 2018  (8)
  • March 2018  (2)
  • November 2017  (1)
  • October 2017  (1)
  • September 2017  (3)
  • August 2017  (2)
  • July 2017  (3)
  • June 2017  (5)
  • May 2017  (4)
  • April 2017  (6)
  • March 2017  (8)
  • February 2017  (6)
  • January 2017  (4)
  • December 2016  (3)
  • November 2016  (4)
  • October 2016  (2)
  • September 2016  (3)
  • August 2016  (3)
  • July 2016  (2)
  • June 2016  (3)
  • May 2016  (3)
  • April 2016  (2)
  • March 2016  (3)
  • February 2016  (3)
  • January 2016  (4)
  • December 2015  (3)
  • November 2015  (4)
  • October 2015  (4)
  • September 2015  (5)
  • August 2015  (2)
  • July 2015  (2)
  • June 2015  (5)
  • May 2015  (3)
  • March 2015  (3)
  • October 2014  (4)
  • September 2014  (9)
  • August 2014  (4)
  • July 2014  (6)
  • June 2014  (1)
  • May 2014  (3)
  • April 2014  (2)
  • January 2014  (1)