faceIndex looks promising, but will not actually get something you’re likely to consider useful. The “faces” counted by that property are the tessellation of the mesh, so a cube won’t be a collection of six quads, it’ll be twelve triangles. (Or more: in some cases, even a flat-sided cube will be tessellated with more than … Read more
At first you have to check if ARGeoTrackingConfiguration is supported on your device. Requirements: You need a device with A12+ chip and cellular (GPS) support. import ARKit @main class AppDelegate: UIResponder, UIApplicationDelegate { var window: UIWindow? func application(_ application: UIApplication, didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?) -> Bool { if !ARGeoTrackingConfiguration.isSupported { let sb = UIStoryboard(name: “Main”, … Read more
I suppose, you can’t see your 3D objects in the scene using GLKMatrix4MakeOrtho, due to the fact that so many classes of GLKit for iOS and macOS are deprecated now. In order to see your 3D object, you need to manually set Far Z Clipping parameter in Attributes Inspector. These two fields are near and … Read more
As explained in the Advances in SceneKit Rendering session from WWDC 2016, SceneKit now defaults to rendering in linear space which is required to have accurate results from lighting equations. The difference you see comes from the fact that in the MetalKit case you are providing color components (red, green and blue values) in the … Read more
Maybe you can use the projectPoint function of the SCNSceneRenderer. extension ARFaceAnchor{ // struct to store the 3d vertex and the 2d projection point struct VerticesAndProjection { var vertex: SIMD3<Float> var projected: CGPoint } // return a struct with vertices and projection func verticeAndProjection(to view: ARSCNView) -> [VerticesAndProjection]{ let points = geometry.vertices.compactMap({ (vertex) -> VerticesAndProjection? … Read more
You don’t need to use invisible geometry — Scene Kit can do all the coordinate conversions you need without having to hit test invisible objects. Basically you need to do the same thing you would in a 2D drawing app for moving an object: find the offset between the mouseDown: location and the object position, … Read more
You don’t need this much math — it’s all math that SceneKit is effectively already doing, so you just need to ask it for the right results. [How do I] produce the SCNVector3 that puts the node in “front” of the camera at a given distance? In the local coordinate system of a node hosting … Read more
First, you need your character in the T-Position only. Download that file as Collada (DAE) with the Skin. Do NOT include any animations to this File. No Further modifications are required to this file then. Then, for any animation effect you will implement like walking, running, dancing, or whatever – do it like so: Test/Apply … Read more
ARKit – Apply CIFilter to a specific vertices of ARFaceAnchor
Updated: October 08, 2022. TL;DR This post is not only about RealityKit, SceneKit & Metal, but also about related APIs and USD files. RealityKit 2.0 RealityKit (and RealityFoundation) is the youngest SDK in Apple family of rendering technologies. This high-level framework was released in 2019. RealityKit is made for AR / VR projects, has simplified … Read more