Smartphone Cameras vs Reality! - PHON SOYTRY

 So there are three cameras on the back Of the iPhone, 13 Pro. The main camera, the ultra wide and the telephoto. So this one down here at the bottom, This is the main camera. So if you cover it with your finger, You can see the frame goes dark, makes sense. If you cover the other two, nothing happens. Now when you hit that 3X button To zoom into 3X It’s supposed to switch to that telephoto camera, right? But sometimes when you zoom into 3X And then cover the main camera, it still goes dark. Why? This is because the iPhone’s camera thinks It knows better than you. And it usually does, Basically in certain conditions, Especially with lower light, You could get a worse photo out of actually switching To the telephoto camera. Which is a smaller sensor with a smaller aperture That lets in less light and can be more noisy. So sometimes when you hit that 3X, It just crops in on the main, big camera, And doesn’t even tell you, And that’s actually going to give you a better photo. See smartphone cameras are smart But something I’ve been thinking a lot about lately Is they’ve gone past smart. They’re bending reality. So I’m in the middle of running The blind smartphone camera test over On Instagram right now. If you haven’t already gotten in on started voting on those, You should do it. It’s a fascinating experiment every time. But a thought I’ve had is maybe it’s not just The brightest photo that’s going to win every single time. So I actually think that similar To how in this tech bubble, We underestimate how many people put cases on their phones. At least I do. There’s also a bit of an underestimation Of how many people want to just be able To take a photo and post it with zero edits. 

Smartphone Cameras vs Reality! - PHON SOYTRY

Now that’s kind of crazy in the tech world or in The photography world. We want the more neutral photo, The one with more information, And that’s the better photo to us. ‘Cause then we can go take it and edit it And make it exactly how we want, Because we want that control. But to most people, If they can just take their phone and point and shoot, And the photo that comes out of that Is perfectly good enough to post with no edits at all. That to them is a great camera. And now you’re letting, of course the camera do all Of the editing for you, Which means you have the least amount Of control over the final look. Now the danger of giving up all the control Is our photos become a product Of someone else’s vision technically. And this is where it starts To get crazy because every smartphone company sees things A little differently, right? We already know a Pixel photo looks different from An iPhone photo, which looks different from Huawei phones, Which look different from Xiaomi shots. Every picture is the result of an image processing pipeline That is tuned by people. And that is a reflection of their biases and their skills And what they think we want. Which means every photo we take, Even if it’s of the same thing will be slightly different, Just depending on what camera you take it with. Which one is real, which one’s the most accurate. Maybe it doesn’t matter. In 2019, the Huawei P30 Pro came out. It had a pretty solid set of cameras. It was a flagship phone, of course, So people went out and tested its limits And pretty quickly something sort of fishy came up. So when you went outside at night And pointed the new periscope zoom camera At the moon and zoomed all the way in, The camera would recognize the moon And suggest you turn moon mode on. And people started doing this and posting their results. And everyone’s pictures of The moon looked surprisingly similar. Now, maybe I shouldn’t be shocked. I mean, we’re all taking pictures of the same moon, But have you ever tried to take a picture of the moon with Your camera on your phone? It’s usually just a blob. It never looks that good. And these all looked really good. Maybe a little too good. And that’s what Android Authority concluded With enough samples. They believe that Huawei is using AI to not just recognize That you’re taking a picture of the moon, But also to then super impose a stored image of the moon And merge it onto your photo. 

Now at first glance, that’s pretty crazy, But that’s also kind of clever because the moon Is tidally locked with the earth. Meaning one rotation takes the same amount Of time as one orbit. So one face of the moon is always pointing towards earth. So you only see one side of the moon all the time, Meaning it’s always going to look the same And you only need one stored image of the moon To superimpose over everyone’s photos. So maybe that’s not so bad. But Huawei denied this, of course. But the seed was definitely planted. And my take, honestly at the time was like, all right, well, You have this AI mode in your camera anyway, And it’s already recognizing scenes and adjusting things And changing things to enhance your photos already. Why not add a picture of the moon in there. But it does bring up the question, A totally fair question, Which is how far is too far? Like, people already seem to want the most finished version Of their photos straight out of camera. And so you’re doing edits and enhancements. How far is too far. Xiaomi phones we already know can detect A landscape and make the blue sky bluer, Or they’ll crank up the green on the green grass. But also some of these phones from Chinese vendors Have very different acceptable levels Of body and face adjustment. So this Xiaomi Mi 11 Ultra when you open The selfie camera has a beauty filter, But this isn’t just facial smoothing. It literally lets you move your hair line, Changes the shape of your chin and your nose. It can slender up your face. It changes the size of your lips and your cheeks. It can make your eyes bigger or smaller And you can put makeup on yourself. And it’s all just built into the camera out The box and it’s totally normal and accepted. It kind of reminds me of when there was A sort of a commercialized version of this when The Galaxy S9 in the United States Had a Bixby Vision feature to try on makeup. And then you could swap between different shades Of lipstick and blush and eye shadow. And then Bixby would give you a link to buy The actual retail version of that makeup. But really the most powerful adjustments are the ones That happen when you don’t even know it. And you didn’t even ask for it. They happen in the background, It’s the highest level of computational photography. So Google’s Pixel 6 is always running the main camera At one shutter speed and the ultra-wide camera At a much faster shutter speed at the same time. So if you take a photo of a moving person, The phone detects the face, realizes if it’s blurry, It can take a non blurry copy from the ultra wide camera And merge it onto your subject to keep just The face crisp and clear. All of this happens in the background without You even asking. And there’s also already a feature in FaceTime On iPhone’s called eye contact that moves your pupils To make it look like You’re making eye contact with the camera. Even though you’re not, You’re looking at the screen below the camera, But it’s pretty eerie and slightly creepy. And it works a little too well, But at least you can turn it off. And I could swear this was a feature somewhere. I must’ve been imagining a keynote, But I can’t find it anywhere. 

Smartphone Cameras vs Reality! - PHON SOYTRY

Go To Download

So I’m gonna predict that this feature will exist At some point in some phone, probably in something like A pixel first. Imagine you’re taking a group selfie shot. There’s a bunch of people with you. You hit the shutter button and almost everyone Has their face not blinking and smiling, But at different moments, Everyone has sort of their ideal face. So the software smartly goes through and merges The best smiling, non blinking face For everyone in the selfie. It doesn’t even tell you just does it in the background. We’ve actually seen versions of this working Our way up to this feature. So believe it or not in 2012 a Nokia Lumia phone Had a selfie mode where you’d hold for five seconds. And then after the shot, You could scroll between five different faces Of selfies to pick which one you like the best. So it sounds crazy, But that’s the thought I’ve been having is This is the direction smartphone cameras are going, Which is as computational photography gets better and better And we’re merging more and more things in. Eventually these cameras are outputting captures Of moments in time that never really happened. So it’s easy to see a future Where smartphone cameras just recognize all kinds Of things like AI mode right now is pretty basic. It’ll see a sunset and make the oranges brighter, But maybe it’ll start recognizing all types of objects. You’re in front of a popular Instagram wall In Santa Monica somewhere. And it notices you take a picture in front of it. It’s like, oh, I have a downloaded picture Of that in our database. And it just wipes out all the people in the background And makes you perfectly flat on that image without You even asking, that could happen in the future. At that point basically The whole world turns into AI recognizable QR codes, Where your AI camera’s just being triggered by all sorts Of objects and things around you To morph into recognized situations. It is kind of crazy to think about, But while we’re in this new reflective mode, Shout out to new channel sponsor Cash App. Cash App I’d say is just the right level of futuristic. So it’s already a great app for sending and requesting money From your friends or get dinner with somebody And just want to reimburse them, that’s easy. But you can also buy stocks or buy Bitcoin with it. So if you haven’t already signed up, Feel free to use the link below, Or my code Marques and 15 bucks will just appear In your account, you’re welcome. Also $10 will go to Girls Who Code. But yeah, my take is I don’t have a solution For this eerily dystopian smartphone camera future, But I wonder, are you okay With smartphone cameras spitting out finished images That are further and further from reality. They’re basically bending the definition of a photo. Let me know what you think. Either way, that’s been it.