PinePhone and PineTab - Mobile Image Enhancement Techniques
#1
Photo 
There are a few interesting mobile image enhancement techniques which could be very useful if implemented on the PINE64 mobile devices. They could very well improve the decent cameras on the devices to something quite admirable.

The main projects I'd like to see implemented are:

HDRnet - uses downsampling and neural networks to improve image truth, vibrancy, or style. Already has been shown to work on mobile with speed. An open source (Apache 2.0) implementation can be found at https://github.com/mgharbi/hdrnet/ and https://github.com/google/hdrnet/

HDR+ - better automatic RAW development, can align multiple frames and improve color range. I believe it is used on Google phones. An open source (MIT,  maybe incomplete) implementation can be found at https://github.com/timothybrooks/hdr-plus

Handheld Multi-frame Super-resolution - merges many images (like those from a live photo) into a higher resolution image. It might be used on Google phones. I don't know of any existing working open source implementation, but this (MIT, very incomplete) may implement it in the future https://github.com/JVision/Handheld-Mult...Resolution

Learning to See in the Dark - intelligent RAW developer which can brighten an image by an extremely large magnitude. I am unsure about the performance, especially on mobile. An open source (MIT) implementation can be found at https://github.com/cchen156/Learning-to-See-in-the-Dark

I mention these projects on the PINE64 forums rather than another forum (like the PostmarketOS or Ubuntu Touch forums) because these projects would likely benefit from firmware enhancements, and splitting the topics across many forums would be a pain to deal with.

I should also mention that I'm in no way a neural network or image processing expert, but I'm sure some other members of the forum are. Maybe this post will catch their interest?
#2
(09-13-2019, 09:23 AM)alexandercrypto Wrote: There are a few interesting mobile image enhancement techniques which could be very useful if implemented on the PINE64 mobile devices. They could very well improve the decent cameras on the devices to something quite admirable.

The main projects I'd like to see implemented are:

HDRnet - uses downsampling and neural networks to improve image truth, vibrancy, or style. Already has been shown to work on mobile with speed. An open source (Apache 2.0) implementation can be found at https://github.com/mgharbi/hdrnet/ and https://github.com/google/hdrnet/

HDR+ - better automatic RAW development, can align multiple frames and improve color range. I believe it is used on Google phones. An open source (MIT,  maybe incomplete) implementation can be found at https://github.com/timothybrooks/hdr-plus

Handheld Multi-frame Super-resolution - merges many images (like those from a live photo) into a higher resolution image. It might be used on Google phones. I don't know of any existing working open source implementation, but this (MIT, very incomplete) may implement it in the future https://github.com/JVision/Handheld-Mult...Resolution

Learning to See in the Dark - intelligent RAW developer which can brighten an image by an extremely large magnitude. I am unsure about the performance, especially on mobile. An open source (MIT) implementation can be found at https://github.com/cchen156/Learning-to-See-in-the-Dark

I mention these projects on the PINE64 forums rather than another forum (like the PostmarketOS or Ubuntu Touch forums) because these projects would likely benefit from firmware enhancements, and splitting the topics across many forums would be a pain to deal with.

I should also mention that I'm in no way a neural network or image processing expert, but I'm sure some other members of the forum are. Maybe this post will catch their interest?

Thanks on the tips, very useful information.


Possibly Related Threads…
Thread Author Replies Views Last Post
  pinephone 3 ideas aular 5 1,501 11-08-2024, 06:35 AM
Last Post: KC9UDX
  Pinetab 2 Not Powering On... FortranTraffic 3 470 09-29-2024, 12:25 PM
Last Post: tllim
  Is the Linux mobile phone still developing? CleanEnvironment 5 1,163 08-07-2024, 06:25 PM
Last Post: KC9UDX
  PinePhone Pro and PinePhone Community Edition Different SIM Card Trays dorkydev 2 1,020 04-11-2024, 03:10 PM
Last Post: Kevin Kofler
  Where PinePhone Pro are Made Tony90 1 1,005 01-18-2024, 09:20 AM
Last Post: Kevin Kofler
  using Zoom on Pinephone andrew907 5 1,982 12-09-2023, 01:26 AM
Last Post: crocspot
  star64-image-minimal-star64-2.1 & X fonts tantamount 0 770 10-02-2023, 07:02 PM
Last Post: tantamount
  Does pinephone allow you to repair your own device as easily as fairphone? unix21311 3 2,573 11-06-2022, 10:37 PM
Last Post: Harolddavies0
  can i install mobian on pinephone? luofeiyu 2 1,718 10-15-2022, 07:31 AM
Last Post: user641
  Does the pinephone have hardware kill switches located on the outside of the phone? unix21311 2 2,479 10-03-2022, 05:53 AM
Last Post: unix21311

Forum Jump:


Users browsing this thread: 1 Guest(s)