• Welcome to TechPowerUp Forums, Guest! Please check out our forum guidelines for info related to our community.

"Zoom and Enhance" to Become a Reality Thanks to Machine Learning

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
37,807 (8.49/day)
Location
Hyderabad, India
Processor AMD Ryzen 7 2700X
Motherboard ASUS ROG Strix B450-E Gaming
Cooling AMD Wraith Prism
Memory 2x 16GB Corsair Vengeance LPX DDR4-3000
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) Samsung U28D590 28-inch 4K UHD
Case Corsair Carbide 100R
Audio Device(s) Creative Sound Blaster Recon3D PCIe
Power Supply Cooler Master MWE Gold 650W
Mouse Razer Abyssus
Keyboard Microsoft Sidewinder X4
Software Windows 10 Pro
The one phrase from television that makes IT people and creative professionals cringe the most is "zoom and enhance" - the notion that you zoom into a digital image and, at the push of a button, it converts a pixellated image into something with details - which lets CSI catch the bad guys. Up until now, this has been laughably impossible. Images are made up of dots called pixels, and the more pixels you have, the more details you can have in your image (resolution). Zooming into images eventually shows you a colorful checkerboard that's proud of its identity.

Google is tapping into machine-learning, in an attempt to change this. The company has reportedly come up with a machine-learning technique that attempts to reconstruct details in low-resolution images. Google is calling this RAISR (rapid and accurate image super-resolution). The technology works with the software learning "edges" of a picture (portions of the image with drastic changes in color and brightness gradients), and attempts to reconstruct them. What makes this different from conventional super-sampling methods is its machine-learning component. A low-resolution image is studied by the machine to invent an upscaling method most effective for the image, in-situ. While its application in law-enforcement is tricky, and will only become a reality when a reasonably high court of law sets a spectacular precedent; this technology could have commercial applications in up-scaling low-resolution movies to new formats such as 4K Ultra HD, and perhaps even 8K.



View at TechPowerUp Main Site
 
Joined
Nov 4, 2005
Messages
10,451 (2.03/day)
System Name MoFo 2
Processor AMD PhenomII 1100T @ 4.2Ghz
Motherboard Asus Crosshair IV
Cooling Swiftec 655 pump, Apogee GT,, MCR360mm Rad, 1/2 loop.
Memory 8GB DDR3-2133 @ 1900 8.9.9.24 1T
Video Card(s) HD7970 1250/1750
Storage Agility 3 SSD 6TB RAID 0 on RAID Card
Display(s) 46" 1080P Toshiba LCD
Case Rosewill R6A34-BK modded (thanks to MKmods)
Audio Device(s) ATI HDMI
Power Supply 750W PC Power & Cooling modded (thanks to MKmods)
Software A lot.
Benchmark Scores Its fast. Enough.
Meh, what happens when the machine is only as good as humans as juxtaposing what might be there, will we still place faith in what a machine with AI does when all it knows is averages, and puts an average face on a pixelated "cleaned up" image and gets someone innocent thrown in jail?
 
Joined
Aug 17, 2016
Messages
831 (0.68/day)
System Name Gaming Desktop
Processor i7 6700k
Motherboard asus rog alpha
Cooling H110i
Memory Corsair Dominator 16gb DDR4 3200
Video Card(s) GTX 1080
Storage EVO 840 500gb, EVO 850 500gb, Perc 710 Raid WD RED 4tbx4
Case Corsair 500r
Power Supply Antec 850
Mouse Logitec G502
Keyboard a cheap dell
Meh, what happens when the machine is only as good as humans as juxtaposing what might be there, will we still place faith in what a machine with AI does when all it knows is averages, and puts an average face on a pixelated "cleaned up" image and gets someone innocent thrown in jail?
i'd trust a cleaned up image far more than i trust the average human to remember what happened at a crime scene. if we're convicting people based on a single image then we're already screwed.
 
Joined
Aug 20, 2007
Messages
12,100 (2.69/day)
System Name Pioneer
Processor Intel i9 9900k
Motherboard ASRock Z390 Taichi
Cooling Noctua NH-D15 + A whole lotta Sunon and Corsair Maglev blower fans...
Memory G.SKILL TridentZ Series 32GB (4 x 8GB) DDR4-3200 @ 13-13-13-33-2T
Video Card(s) EVGA GTX 1080 FTW2
Storage Mushkin Pilot-E 2TB NVMe SSD w/ EKWB M.2 Heatsink
Display(s) LG 32GK850G-B 1440p 32" AMVA Panel G-Sync 144hz Display
Case Thermaltake Core X31
Audio Device(s) Onboard TOSLINK to Schiit Modi MB to Schiit Asgard 2 Amp to AKG K7XX Ruby Red Massdrop Headphones
Power Supply EVGA SuperNova T2 850W 80Plus Titanium
Mouse ROCCAT Kone EMP
Keyboard WASD CODE 104-Key w/ Cherry MX Green Keyswitches, Doubleshot Vortex PBT White Transluscent Keycaps
Software Windows 10 x64 Enterprise... yes, it's legit.
i'd trust a cleaned up image far more than i trust the average human to remember what happened at a crime scene. if we're convicting people based on a single image then we're already screwed.
Except we're not talking "cleaned up." We're talking outright creation of new data from adjacent pixels to fill in what should rightfully be nothingness.

Given that, frankly, I wouldn't trust it at all.
 
Joined
Apr 4, 2008
Messages
4,682 (1.10/day)
System Name Obelisc
Processor i7 3770k @ 4.8 GHz
Motherboard Asus P8Z77-V
Cooling H110
Memory 16GB(4x4) @ 2400 MHz 9-11-11-31
Video Card(s) GTX 780 Ti
Storage 850 EVO 1TB, 2x 5TB Toshiba
Case T81
Audio Device(s) X-Fi Titanium HD
Power Supply EVGA 850 T2 80+ TITANIUM
Software Win10 64bit
There's already ways to do this now. The latest "waifu2x" has a photo mode and the output looks just like that. Results are a real hit or miss but it works surprisingly well sometimes.
 
Joined
Oct 2, 2004
Messages
13,791 (2.48/day)
If you've been living under a rock, this is something "new". If you know this tech from years ago, it's called S-Spline filter, developed by Benvista and used in their PhotoZoom.

http://www.benvista.com/photozoompro/examples

I've also used their S-Spline filter to optimize System Shock 2 cutscenes...

https://rejzor.wordpress.com/2015/05/26/system-shock-2-high-definition-cutscenes/

Clearly, you can't pull non existent information out of your ass, but advanced prediction algorithms can certainly elevate the image details far beyond high quality filters like Bicubic or Lanczos.
 
Joined
Mar 30, 2011
Messages
803 (0.25/day)
Location
Pocomoke, MD
System Name Good Enough
Processor Intel G3258 @ 3.8ghz
Motherboard Gigabyte GA-H81M-H
Cooling Stock
Memory G.Skill Ripjaws 8gb
Video Card(s) MSI 650 ti Boost
Storage Crucial MX100 128gb SSD
Display(s) ASUS VN248
Case Coolermaster Ammo 533
Audio Device(s) Realtek ALC887
Power Supply Antec BP550
Mouse G502
Keyboard Sidewinder x4
Software Windows 7
Joined
Jan 29, 2012
Messages
5,485 (1.91/day)
Location
Florida
System Name natr0n-PC
Processor 2600K @ 4.4GHz / Dual Xeon 5675's @ 3.33GHz 12c/24t
Motherboard Sabertooth Z77 / GA-7TESM
Cooling Deepcool Assassin - 3 Fans / Custom
Memory 2x8GB 2133MHz Samsung Dual Channel / 6x4GB 1333MHz Samsung Hexa Channel
Video Card(s) Evga GTX 980 SC / Asus Strix 980ti
Storage Various SSD/HD
Display(s) Samsung 23' 2048x1152 / Various Dells
Case Sunbeam Transformer Silver / Matrexx 55
Audio Device(s) SB X-fi on all systems
Power Supply Corsair TX 650w / Evga NEX 750B
Mouse Alienware AW558 @ 5000 DPI
Keyboard Asus KB34211
Software XP64/7/8.1/10
Benchmark Scores http://valid.x86.fr/79kuh6
I bet emulation forum users are shitting the floor with this news.
 
Joined
Jun 20, 2007
Messages
3,855 (0.85/day)
System Name Medusa
Processor i7 2600k @4.8ghz
Motherboard Asus P8P67 Pro
Cooling CPU : Noctua NH-L12 GPU: EK FC 1080 via Magicool 360 III PRO > Photon 170 (D5)
Memory 8gb Corsair XMS DDR3 @1600mhz
Video Card(s) GTX 1080 FE
Storage Vertex 4 256 /Crucial C300 256/ Hitachi 2TB 2x
Display(s) Tempest X270OC @ 120hz / LG W3000h
Case Fractal Define S [Antec Skeleton hanging in hall of fame]
Audio Device(s) Asus Xonar Xense with AKG K612 cans on Monacor SA-100
Power Supply Seasonic X-850
Mouse Razer Naga 2014
Software Windows 10 Pro
Benchmark Scores FFXIV ARR Benchmark 1600p score 12,098[this means nothing any more!]
Meh, what happens when the machine is only as good as humans as juxtaposing what might be there, will we still place faith in what a machine with AI does when all it knows is averages, and puts an average face on a pixelated "cleaned up" image and gets someone innocent thrown in jail?
I believe that's why he mentions that a spectacular precedent would have to set.
 
Joined
Oct 21, 2005
Messages
5,666 (1.10/day)
Location
USA
System Name Small ATX Desktop
Processor Intel i5 8600K @ 4.6 GHz Core & 4.3 GHz Uncore @ 1.168V
Motherboard Asrock Z370 Taichi
Cooling Phanteks PH-TC14PE, MonoPlus, Fans: 2xThermalright TY143 / 2xCorsair SP-120L / 2xYate Loon D14BH-12
Memory G-Skill TridentZ 2X8GB DDR4 3200 CL14 F4-3200C14D-16GTZ @ 3200 14-14-14-34 2T @ 1.35V
Video Card(s) Zotac 1060 6GB Mini ZT-P10600A-10L with Arctic MonoPlus and Yate Loon D14BH-12 Fan
Storage OS Samsung 970 Pro 512GB NVMe, Games Phison E12 NVMe 1TB, HDD WD Black 4TB WD4005FZBX, 2xWD10EZEX
Display(s) 2x Asus PB258Q 2560x1440 25" IPS
Case Lian Li PC A05NB (Inverted Mobo)
Audio Device(s) Audiotechnica ATH M50X, Antlion Mod Mic 4, SYBA SD-CM-UAUD, Acoustic Research 2Ch Speakers
Power Supply Seasonic SS-660XP2 660 Watt Platinum
Mouse Zowie EC2A Mouse, Razer Naga Chroma '14, Corsair MM600, Inateck 900x300 XL pad, Tiger Gaming Skates.
Keyboard Filco Majestouch II Ninja TKL, Goldtouch GTC 0033 Ten Key, PS3 Controller
Software Win7 Pro 64 (Installed on Coffee Lake using AsRock's handy PS/2 Simulator in Bios)
Joined
Oct 2, 2004
Messages
13,791 (2.48/day)
If I had the tools to quickly process textures, I'd use PhotoZoom on old games and scale them up to higher resolutions (if game engines support higher res).
 
Joined
Sep 15, 2011
Messages
5,322 (1.77/day)
Processor Intel Core i7 3770k @ 4.3GHz
Motherboard Asus P8Z77-V LK
Memory 16GB(2x8) DDR3@2133MHz 1.5v Patriot
Video Card(s) MSI GeForce GTX 1080 GAMING X 8G
Storage 59.63GB Samsung SSD 830 + 465.76 GB Samsung SSD 840 EVO + 2TB Hitachi + 300GB Velociraptor HDD
Display(s) Acer Predator X34 3440x1440@100Hz G-Sync
Case NZXT PHANTOM410-BK
Audio Device(s) Creative X-Fi Titanium PCIe
Power Supply Corsair 850W
Mouse Anker
Software Win 10 Pro - 64bit
Benchmark Scores 30FPS in NFS:Rivals
I always got cracked up of that scene, lol. The resolution of that film must have been, what, 512K? in order to pull that kind of detail.
 
Joined
Mar 6, 2012
Messages
504 (0.18/day)
Processor i5 4670K - @ 4.8GHZ core
Motherboard MSI Z87 G43
Cooling Thermalright Ultra-120 *(Modded to fit on this motherboard)
Memory 16GB 2400MHZ
Video Card(s) HD7970 GHZ edition Sapphire
Storage Samsung 120GB 850 EVO & 4X 2TB HDD (Seagate)
Display(s) 42" Panasonice LED TV @120Hz
Case Corsair 200R
Audio Device(s) Xfi Xtreme Music with Hyper X Core
Power Supply Cooler Master 700 Watts

cdawall

where the hell are my stars
Joined
Jul 23, 2006
Messages
27,650 (5.65/day)
Location
Houston
System Name All the cores || Into the Blue
Processor 2990WX || 5960X
Motherboard Asrock X399M || Asus X99M WS
Cooling CPU-XSPC RayStorm Neo, 2x240mm+360mm, D5PWM+140mL, GPU-2x360mm, 2xbyski, D4+D5+100mL || TBD
Memory 4x8GB G.Skill Trident Z 3200 CL16 || EVGA 3200 2x8GB
Video Card(s) (2) EVGA SC BLACK 1080Ti's || EVGA 1080Ti FE
Storage 2x Samsung SM951 512GB, Samsung PM961 512GB || OCZ Vector 180 480GB
Display(s) Dell UP2414Q 3840X2160@60hz || TBD
Case Caselabs Mercury S5+pedestal || Supermicro S5 (GS5A-753K)
Audio Device(s) Fischer HA-02->Fischer FA-002W High edition/FA-003/Jubilate/FA-011 depending on my mood
Power Supply Seasonic Prime 1200w || Seasonic Snow Silent 750w
Mouse Thermaltake Theron, Steam controller || TBD
Keyboard Thermaltake Poseidon ZX, Steam controller || Corsair K70
Software W10P || W10P

btarunr

Editor & Senior Moderator
Staff member
Joined
Oct 9, 2007
Messages
37,807 (8.49/day)
Location
Hyderabad, India
Processor AMD Ryzen 7 2700X
Motherboard ASUS ROG Strix B450-E Gaming
Cooling AMD Wraith Prism
Memory 2x 16GB Corsair Vengeance LPX DDR4-3000
Video Card(s) Palit GeForce RTX 2080 SUPER GameRock
Storage Western Digital Black NVMe 512GB
Display(s) Samsung U28D590 28-inch 4K UHD
Case Corsair Carbide 100R
Audio Device(s) Creative Sound Blaster Recon3D PCIe
Power Supply Cooler Master MWE Gold 650W
Mouse Razer Abyssus
Keyboard Microsoft Sidewinder X4
Software Windows 10 Pro
Joined
Mar 6, 2012
Messages
504 (0.18/day)
Processor i5 4670K - @ 4.8GHZ core
Motherboard MSI Z87 G43
Cooling Thermalright Ultra-120 *(Modded to fit on this motherboard)
Memory 16GB 2400MHZ
Video Card(s) HD7970 GHZ edition Sapphire
Storage Samsung 120GB 850 EVO & 4X 2TB HDD (Seagate)
Display(s) 42" Panasonice LED TV @120Hz
Case Corsair 200R
Audio Device(s) Xfi Xtreme Music with Hyper X Core
Power Supply Cooler Master 700 Watts
I did not forget because it does not figure in the source article.
Agreed, your source link doesn't mention AMD at all...
 
Joined
Jul 14, 2008
Messages
646 (0.15/day)
Location
Copenhagen, Denmark
System Name Ryzen/Laptop
Processor R9 3900X/i7 6700HQ
Motherboard AsRock X470 Taichi/Acer
Cooling Corsair H115i pro with 2 Noctua NF-A14 chromax/OEM
Memory G.Skill Trident Z 32GB @3200/16GB DDR4 2666 HyperX impact
Video Card(s) TUL Red Dragon Vega 56/Intel HD 530 - GTX 950m
Storage Samsung 970pro NVMe 512GB,Samsung 860evo 1TB, 3x4TB WD gold enterprise /Transcend 830s, 1TB Toshiba
Display(s) Philips FTV 32 inch + Dell 2407WFP-HC/OEM
Case Phanteks Enthoo Luxe/Acer Barebone
Audio Device(s) SoundBlasterX AE-5 (Dell A525)(HyperX Cloud Alpha)/mojo
Power Supply Seasonic focus+ 850 platinum (SSR-850PX)/165 Watt power brick
Mouse G502 Hero/M705 Marathon
Keyboard G19
Software Win10 pro 64bit
its so nice to live in an age with such technological achievements!
 
Joined
Feb 8, 2012
Messages
2,934 (1.02/day)
Location
Zagreb, Croatia
System Name Windows 7 64-bit Core i5 3570K
Processor Intel Core i5 3570K @ 4.2 GHz, 1.26 V
Motherboard Gigabyte GA-Z77MX-D3H
Cooling Scythe Katana 4
Memory 4 x 4 GB G-Skill Sniper DDR3 @ 1600 MHz
Video Card(s) Gainward NVIDIA GeForce GTX 970 Phantom
Storage Western Digital Caviar Blue 1 TB, Seagate Baracuda 1 TB
Display(s) Dell P2414H
Case CoolerMaster Silencio 550
Audio Device(s) VIA HD Audio
Power Supply Corsair TX v2 650W
Mouse Steelseries Sensei
Keyboard CM Storm Quickfire Pro, Cherry MX Reds
Software MS Windows 7 Enterprise 64-bit SP1
Joined
May 21, 2011
Messages
660 (0.21/day)
System Name Tiger1-Workstation
Processor Intel XEON E3-1275V2 / E3-1230V3
Motherboard ASUS SABERTOOTH Z77 / AsRock H87 Performance
Cooling Corsair H80i Watercooling
Memory 32GB Corsair Dominator Platinum 2400
Video Card(s) Inno3D GTX 780 Ti
Storage 2TB SSD(4X OCZ vertex 4 256GB LSI RAID0 + Crucial M550 1TB)
Display(s) 2x Dell U3011 30" IPS
Case Silverstone Raven 03
Audio Device(s) Xonar Essence STX--> Xonar Essence One --> SPL Auditor -->Hivi X6
Power Supply Corsair AX860i Platinum
Software Windows 8.1 Enterprise
Joined
Jul 16, 2014
Messages
3,235 (1.64/day)
Location
SE Michigan
System Name Dumbass
Processor AMD-9370BE @4.6
Motherboard ASUS SABERTOOTH 990FX R2.0 +SB950
Cooling CM Nepton 280L
Memory G.Skill Sniper 16gb DDR3 2400
Video Card(s) GreenTeam 1080 Gaming X 8GB
Storage C:\SSD (240GB), D:\Seagate (2TB), E:\Western Digital (1TB)
Display(s) 1x Nixeus NX_EDG27, 2x Dell S2440L (16:9)
Case Phanteks Enthoo Primo w/8 140mm SP Fans
Audio Device(s) onboard (realtek?) SPKRS:Logitech Z623 200w 2.1
Power Supply Corsair HX1000i
Mouse Logitech G700s
Keyboard Logitech G910 Orion Spark
Software windows 10
Benchmark Scores https://i.imgur.com/aoz3vWY.jpg?2
8k resolution, is that like Jetsons 3D tv? :D
 
Joined
May 21, 2011
Messages
660 (0.21/day)
System Name Tiger1-Workstation
Processor Intel XEON E3-1275V2 / E3-1230V3
Motherboard ASUS SABERTOOTH Z77 / AsRock H87 Performance
Cooling Corsair H80i Watercooling
Memory 32GB Corsair Dominator Platinum 2400
Video Card(s) Inno3D GTX 780 Ti
Storage 2TB SSD(4X OCZ vertex 4 256GB LSI RAID0 + Crucial M550 1TB)
Display(s) 2x Dell U3011 30" IPS
Case Silverstone Raven 03
Audio Device(s) Xonar Essence STX--> Xonar Essence One --> SPL Auditor -->Hivi X6
Power Supply Corsair AX860i Platinum
Software Windows 8.1 Enterprise
Top