How the Galaxy S21's AI Improves Your Photos in the Blink of an Eye
June 14, 2021: Samsung has built a legacy of innovative smartphone camera technology that makes it simple for people to take the perfect snapshot—from seasoned pros to complete beginners. Click the shutter and in an instant, you have stunning results, whether it’s a dreamy landscape or a precious family portrait. But a lot happens behind the scenes in that instant, and it’s thanks to the powerful AI onboard Samsung’s flagship Galaxy devices.
The Galaxy S21 series is the latest to feature Samsung’s cutting-edge AI-powered cameras, giving mobile photographers of all skill levels pro-grade tools that work behind-the-scenes to ensure every moment you capture is truly epic. Here, we take a closer look at how AI is improving portraits on the Galaxy S21 series.
Enhanced Selfie Experience
With the Galaxy S21 series’ selfie camera, you’ll always look your best with AI that delivers a more natural look and improved details. There are two key parts to the enhanced selfie experience:
1. Face information detection: When you snap a photo, the AI-powered selfie camera first identifies faces in the image, then segments them from the rest of the details in the scene, and finally applies natural enhancements to your subjects—all in the blink of an eye.
2.Restoration: The natural enhancements include bringing out the details in your subjects’ hair, eyes, and facial features and adjusting white balance to create more natural looking skin tones in any environment.
Samsung also included support for third party apps, so you can take images from your favorite camera or social media app and still get the benefits of AI-powered selfie camera.
Updated Portrait Mode
The new advanced Portrait mode, formerly known as Live Focus, uses improved 3D sensing to deliver photos with more depth and dramatic effects.
When using Portrait mode, you can select from a variety of special effects to apply to your final image. As soon as you click the shutter, the onboard AI begins segmenting, matting, and refining the details of your subjects. Here’s how it works:
1. Segmentation Map: First, the AI immediately recognizes the humans or pets in the scene and generates an instant segmentation map to separate each individual subject.
2. Seed Map: Based on this segmentation map, a seed map of the subjects is generated to which your selected effects will apply. In a portrait, a seed map would separate the background from the main subject.
3. Tri-map: Image processing then adds a tri-map on top of the seed map, to identify the subject, the background, and the areas where they blend together.
4. Matte Map: Matting is then applied to the tri-map to bring out the details in the hair and facial features of your subjects.
5.Depth Estimation: Meanwhile, the AI simultaneously measures depth information to refine the background details and depth-of-field.1
During segmenting, the AI powering Portrait mode is able to discern whether you’re capturing a singular person, a group of people at different depth levels, or a pet.
Refining the Details
After segmenting your subjects, the seed map generates a tri-map where black represents the background, white represents the subject, and gray represents areas of the image that are uncertain.
During image processing when the background is blurred out in Portrait mode, this map ensures that the blur doesn’t overlap with your subject. A matte map is then generated to refine the details in the gray, unknown areas of the scene and to improve the resolution of the image. At the same time matting takes place, the AI uses the seed map to refine the details of the interior parts of the subject. The maps are then combined and upscaled to produce a final, high-resolution portrait where your subjects really pop off the background. Although it seems like quite an extensive process, it all happens within 3 seconds.2
1 Depth-of-field adjustments are only applied when using the Blur effect on portraits of people and animals. If the camera measures an object at the same depth as a person, the effect is not applied, and the image is saved with its natural depth-of-field.
2 Portrait mode processing times may vary depending on the shooting conditions.
Home >> Technology Section
UAE Food Bank and Taya Art Production launch ‘Cook of Thousand Meals' initiative ...
Dubai Police claim wheelchair basketball crown at 11th Nad Al Sheba Sports Tourn ...
Mercato Hosts Special Iftar Event for Students of Determination from Rashid Cent ...
Tag Heuer Ambassador And Skateboarding World Champion Sky Brown Soars Above Towe ...
Students of Sharjah Performing Arts Academy Perform Their Own Production and Exe ...
Ski Dubai, in partnership with Dubai Sports Council, to host DXB Snow Run on 19 ...
Lola Cars returning to top-tier global motorsport with technical partners Yamaha ...
Nissan Becomes First Formula E Manufacturer To Commit To Gen4 Until At Least 203 ...
Mandarin Oriental And Its Global Celebrity Fan, Alia Bhatt, Host The Hope Gala, ...
Hotel Indigo Redefines Art Experience with Launch of Keerthana's First Supper
Roghani, Golestan claim Padel crown at 11th Nad Al Sheba Sports Tournament
ADNOC Distribution Shareholders Approve New Five-Year Dividend Policy As Company ...
flydubai adds two destinations in the Kingdom of Saudi Arabia
Media Statement on the occasion of Zayed Humanitarian Day: Humaid Al Dhaheri, Ma ...
Snap, Savour and Win: Dubai Food Festival and Gulf Photo Plus Launch Photograph ...
Greenpeace MENA Reveals North Africa's Polluters- Time for Urgent Action!
Hotpack Global MD emerges Founding VC of Paper and Tissue Business Group at Duba ...
Dubai Shopping Malls Group Set To Delight Shoppers With New ‘Shop. Scan & Win' E ...
Power to progress: Kia K4 next-generation compact sedan sets new design standard ...
Etihad Rail signs agreement for waste management services with BEEAH Group