[OPEN][RI-IML_2019-CG-DM-HCI-008] Reconstruction of Personalized 3D Human Body Model

This internship will focus on the 3D reconstruction of the human body. Virtual body enables to generate personalized avatars which are more and more required in VR, AR, gaming and many other virtual applications. It helps increasing the embodiment and preventing from cybersickness. The intern will be included in the Immersive Lab within the Virtual Production group at Technicolor Rennes. Several tools and pieces of software developed by the team are available and will be improved. The work will consist in: (1) study the state of the art around 3D reconstruction of human avatars [1], and in particular evaluate a technique based on RGB-D video [2], (2) improve the existing camera rig and reconstruction algorithm in order to provide at the end a realistic digital double of the people.

[1] J. Achenbach, T. Waltemate, M. Erich Latoschik, and M. Botsch. 2017. Fast generation of realistic virtual humans. In Proceedings of the 23rd ACM-VRST '17
[2] Alldieck, T., Magnor, M. A., Xu, W., Theobalt, C., & Pons-Moll, G. (2018). Video Based Reconstruction of 3D People Models. arXiv preprint arXiv:1803.04758.

Skills  : Computer graphics, Python, Deep Learning, Math (optimization and geometry), English, motivated by research.

Keywords  : Geometry Processing, 3D reconstruction, deep learning

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[OPEN][RI-ISL_2019-CG-DM-018] Deep Geometry

3D models are often represented by very large numbers of points or triangles. This makes both storage and image synthesis inefficient, and therefore requires high-end GPUs to produce images. This internship will investigate the possibility of replacing large and detailed 3D models, normally represented as either triangle meshes or point clouds, with deep neural networks. Such networks could then be employed by a renderer to efficiently produce images.

Skills  : machine learning, 3D rendering, Python, C++.

Keywords  : .machine learning, 3D rendering, Python, C++.

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-ISL_2019-CG-CV-VP-017]

The new augmented reality devices: phones, MagicLeap… and the new 3D video standard open the door to create new AR services, making it possible to create applications that integrate real 3D animated characters in the real world. The goal of this internship is to create new experiences to evaluate and promote this kind of technologies mixing 3D video with real environments. The Star Wars holograms can now become real: “Help me. You're my only hope.”

Skills  : - Creative, enthusiast, strength of proposal - Computer Graphics / Computer Vision - Android / iOS programming - ARCore / ARKit / Unity - Ability to write well-structured and documented code - Good written and spoken English - Team working skills

Keywords  : .Augmented Reality, Point Cloud, Android programming

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-IML_2019-CG-DM-VP-007] Deep 3D Object Localization & Tracking for Real / Virtual Fusion

 

To fuse virtual objects with real content (or the opposite) it is necessary to know the parameters of the virtual and real cameras. In particular, the 3D localization of the real camera and the real object needs to be computed and tracked to ensure temporal consistency and fast computing. Current solutions rely on visual pattern tracking. More recent technologies consider fusing information from various sensors as used for automotive applications, such as accelerometer, gyroscope, GPS, LIDAR, radar…The goal of the internship is to improve current algorithms and propose innovative solutions for filtering and fusing the various signals. Deep learning could also be considered as an improvement of existing techniques.

Skills  : Applied Mathematics, Signal Processing, Programming, Computer Vision, Machine/Deep Learning.

Keywords  : Localization, sensors, filtering, machine learning, VFX, movies.

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-IML_2019-CG-HCI-005] Interactive Cage Creation for Facial Mesh Deformation

 

The purpose of the internship is to design and implement an efficient pipeline to 1/ generate automatically high-quality cages for 3D facial meshes and 2/ deform these meshes in the human face deformation space. The intern will be included in the Immersive Lab within the Virtual Production group at Technicolor Rennes. Several tools and software developed by the team are available and will be used. The work will consist in: (1) study the state of the art around cage generation and facial deformations, (2) design a pipeline to generate the cage based on any 3D facial mesh, (3) propose an approach to constrain the deformations space of the cage (4) if there is time, conduct a user study for publication.

Skills  : Computer graphics, Python, Editing/Animation tool (Blender, Maya), Maths (optimization and geometry), English, motivated by research.

Keywords  : Geometry Processing, Facial Animation, Human Interaction

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-ISL_2019-CG-CV-DM-020] Aging 3D Character

In VFX production (film or advertisement) the need to reconstruct 3d actor’s face from video input is increasing. Over the last decade, the technology that pulls out a 3d facial model from a flat image has been improved significantly, while fine-scale mesoscopic detail may miss out. With the recent growth of deep learning techniques, we believe that morphing a 3d character’s age would be possible, by learning “(de-)aging” from data. Done automating this pipeline brings benefits to the VFX industry, reducing manual labour. Our research team is based in Rennes & New York. And collaborates with engineers and artists located at The Mill, New York.

Skills  : Machine learning, Deep-learning, Computer Graphics, Computer Vision, Python, PyTorch, Maya.

Keywords  : .deep network, visual effects, facial rig, 3d reconstruction, shape from shading

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-IML_2019-CG-CV-DM-032] Joint deep completion of geometry and texture for Mixed Reality applications

We are proposing a 6 months internship in the Mixed Reality team, focusing on 3D scene completion with deep learning. The internship could be continued as a PhD scholarship. Scanning indoor scenes with RGB-D sensors usually ends up with incomplete scenes, with many missing geometry and texture details. These are not good enough for high-end Augmented and Mixed Reality applications. Classical approaches try to extrapolate scanned information towards missing regions using basic priors on existing patterns. Deep learning, on the other hand, provides a powerful framework to learn patterns from existing 3D scans and 2D images, from local details to global contextual information, which can be exploited to reconstruct missing parts. We aim at developing a multi-purpose tool for scene completion, based on deep learning, combining both colour and geometry information, respecting constraints provided by scanned regions, and taking scene classification and semantics into account. The solution will be integrated into a larger pipeline, and it will be used for Virtual Reality, Mixed Reality and Diminished Reality applications.

Skills  : Computer Vision, Machine Learning, Image/Video Processing, 3D geometry, C++/Python, fluent English, good team spirit and communication skills

Keywords  : Deep learning, 3D modeling, scene completion, inpainting, semantic labelling, Augmented reality

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-ISL_2019-CG-CV-DM-024] Extraction of quadrupeds motion parameters from video

The goal of the internship is to apply deep learning techniques for the extraction of motion parameters of quadrupeds from video. In order to cope with the lack of ground truth, the approach will build upon both weakly and unsupervised learning. Biomechanical knowledge or possibly tiny manual annotation dataset might also be exploited. The motivation for this work is to develop a statistical model of the motion of some quadrupeds in order to synthesize plausible animation.

The context of this work is the VFX workflow for animated movies industry. This work is part of an effort to automatize the currently very manual process.

The objective is to design the model and the learning methodology for extracting the 3D coordinates of a moving quadruped in video.

The expected outcome of the internship are :
- A model with the quantitative evaluation of its performance
- A description of the approach which might lead to a publication or patent
- A demo which will visually display the produced 3D animation

References
- Zhou, Xingyi, Qixing Huang, Xiao Sun, Xiangyang Xue, and Yichen Wei. "Weakly-supervised Transfer for 3D Human Pose Estimation in the Wild." arXiv preprint arXiv:1704.02447 (2017).
- Newell, Alejandro, Kaiyu Yang, and Jia Deng. "Stacked hourglass networks for human pose estimation." In European Conference on Computer Vision, pp. 483-499. Springer International Publishing, 2016.

Skills  : deep learning

Keywords  : deep learning

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-IML_2019-CG-CV-DM-040] Change Detection & 3D Model Update for Mixed Reality applications

Mixed Reality (MR) applications are based on the creation of a new world that merges 3D virtual assets with the real environment of the user. Reconstructing 3D point clouds or meshes to represent the real world is key, and for the apps to be even more realistic and user engaging, MR experiences should not restrict to static environment but also adapt to temporal changes. This internship will focus on the detection of geometric changes between different observations of the same scene captured at different instants. Semantic segmentation based on deep learning will serve in this process as a powerful tool to identify objects that have been moved, introduced or removed. The oldest 3D model will be updated with the most recent observations.

The intern will be included in the Immersive Lab within the Mixed Reality group at Technicolor Rennes. The proposed solution will be integrated into a larger pipeline and used for MR demonstrations. The internship could be continued as a PhD scholarship. Applicants should be strongly motivated by research.

Skills  : Computer vision, machine learning, 3D geometry, C++/Python, fluent English, good team spirit and communication skills

Keywords  : Deep learning, 3D modelling, semantic labelling, augmented reality

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.

[CLOSED][RI-IML_2019-CG-CV-DM-043] 3D scene relighting for Mixed Reality applications

Mixed Reality (MR) applications are based on the creation of a new world that merges 3D virtual assets with the real environment of the user. These assets are often virtual objects or figures that can move in the real scene. Other MR applications can consist on retexturing or relighting the scene. This latter application is the subject of this internship.

The study will focus on realistic relighting effects in a mixed scene in presence of real lights. The scenarios will include the insertion of virtual lights to produce realistic effects (shadows, shading, specular effects…) as well as the removal of real lighting effects. This requires the estimation of lighting as well as surface reflectance properties in the real scene via image and 3D processing. Moreover, the stability of rendered lighting effects over time will be addressed.

The intern will be included in the Immersive Lab within the Mixed Reality group at Technicolor Rennes. The proposed solution will be integrated into a larger pipeline and used for MR demonstrations. The internship could be continued as a PhD scholarship.

Skills  : computer vision, 3D geometry, C++/Python, machine learning, fluent English, good team spirit and communication skills

Keywords  : lighting and reflectance modelling, 3D modelling, rendering & relighting, mixed reality, deep learning

 

This internship is located in Rennes, France. If interested, please apply at stage.technicolor@technicolor.com  by sending us your resume and a cover letter with the internship reference in the email subject line.