{"id":1841,"date":"2020-08-10T17:31:17","date_gmt":"2020-08-10T17:31:17","guid":{"rendered":"https:\/\/techclot.com\/index.php\/2020\/08\/10\/software-can-recreate-3d-spaces-from-random-internet-photos\/"},"modified":"2020-08-10T17:31:17","modified_gmt":"2020-08-10T17:31:17","slug":"software-can-recreate-3d-spaces-from-random-internet-photos","status":"publish","type":"post","link":"https:\/\/techclot.com\/index.php\/2020\/08\/10\/software-can-recreate-3d-spaces-from-random-internet-photos\/","title":{"rendered":"Software Can Recreate 3D Spaces From Random Internet Photos"},"content":{"rendered":"

Software Can Recreate 3D Spaces From Random Internet Photos<\/a><\/p>\n

\n
\"Software<\/picture><\/div>\n

Screegrab: GitHub\/NeRF-W<\/p>\n<\/div>\n

<\/p>\n

Google researchers have reconstructed incredibly detailed 3D scenes of famous landmarks around the world using photographs taken from the internet and machine learning. <\/p>\n

<\/span><\/p>\n

On the project\u2019s GitHub page<\/a>, researchers shared 3D scenes of the Brandenburg Gate in Berlin, Sacr\u00e9-C\u0153ur in Paris, and the Trevi Fountain in Rome\u2014all created from photographs taken from online sites such as Flickr. The results are impressive 3D renderings in which the view from the camera can be moved and the appearance of the scene changed by different lighting effects.<\/p>\n

<\/span><\/p>\n

The researchers recently shared their methods in a paper titled \u201cNeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections<\/a>\u201d on the arXiv preprint server. The method, which they\u2019ve named NeRF-W, builds upon Neural Radiance Fields (NeRF), which can also be used to reconstruct 3D scenes from a collection of photographs, but may struggle if the photographs are taken outside a controlled setting, according to the paper.<\/p>\n

<\/span><\/p>\n

\u201cThe Neural Radiance Fields (NeRF) approach implicitly models the radiance field and density of a scene within the weights of a neural network. Direct volume rendering is then used to synthesize new views, demonstrating a heretofore unprecedented level of fidelity on a range of challenging scenes,\u201d the researchers write in their paper. <\/p>\n

<\/span><\/p>\n

\u201cHowever, NeRF has only been demonstrated to work well in controlled settings: the scene is captured within a short time frame during which lighting effects remain constant, and all content in the scene is static,\u201d the paper reads.<\/p>\n

<\/span><\/p>\n

The researchers go on to explain that NeRF can struggle when using images that fall outside these parameters\u2014for example, a collection of tourist photographs of Trevi Fountain taken by different people and posted to Flickr. This is because of variances caused by the light changing or things like image exposure or post processing. In addition, photographs sourced from the internet often contain moving objects like people or cars.<\/p>\n

<\/span><\/p>\n

\u201cTwo photographers may stand in the same location and photograph the same landmark, but in the time between those two photographs the world can change significantly: cars and pedestrians may move, construction may begin or end, seasons and weather may change, and the sun may move through the sky,\u201d the paper reads.<\/p>\n

<\/span><\/p>\n

The resulting model may then contain ghosting, oversmoothing, and other artifacts. NeRF-W tackles this issue by introducing extensions that soften NeRF\u2019s assumption that things in the world remain static, the authors explain in the paper, leading to a better result. <\/p>\n

<\/span><\/p>\n

The result of using NeRF-W is the type of realistic 3D reconstruction that is often needed for augmented reality and virtual reality applications, created using stuff from around the web.<\/p>\n

<\/span><\/div>\n<\/p>\n

Published at Mon, 10 Aug 2020 14:03:45 +0000<\/p>\n","protected":false},"excerpt":{"rendered":"

Software Can Recreate 3D Spaces From Random Internet Photos Screegrab: GitHub\/NeRF-W Google researchers have reconstructed incredibly…<\/p>\n","protected":false},"author":12,"featured_media":2336,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[61],"tags":[],"class_list":["post-1841","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-augmented-virtual-reality"],"jetpack_featured_media_url":"https:\/\/i0.wp.com\/techclot.com\/wp-content\/uploads\/2020\/08\/4G1jb9.jpg?fit=500%2C325&ssl=1","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p3orZX-tH","jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts\/1841","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/comments?post=1841"}],"version-history":[{"count":0,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/posts\/1841\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/media\/2336"}],"wp:attachment":[{"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/media?parent=1841"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/categories?post=1841"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/techclot.com\/index.php\/wp-json\/wp\/v2\/tags?post=1841"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}