PINE64
My Daily Manual QA - Printable Version

+- PINE64 (https://forum.pine64.org)
+-- Forum: PinePhone (https://forum.pine64.org/forumdisplay.php?fid=120)
+--- Forum: PinePhone Software (https://forum.pine64.org/forumdisplay.php?fid=121)
+---- Forum: Mobian on PinePhone (https://forum.pine64.org/forumdisplay.php?fid=139)
+---- Thread: My Daily Manual QA (/showthread.php?tid=10811)

Pages: 1 2 3 4 5 6

My Daily Manual QA - plainenough - 07-23-2020

I will be preforming some basic QA against the nightly build.

build image: mobian-pinephone-20200723.img.gz

I have limited my scope to what I consider requirements for a daily driver.  (SMS, 4G Calls, general sound quality, wifi, clock accuracy, etc. etc.)

Wifi: seems fairly stable after reboot. --------------------------------------------------------------------------------------------------------------------------------------------------- PASS
Boot time: Changed reboot from simple restart to battery out cold boot. (~ 1m 15s) ------------------------------------------------------------------------------------------ PASS
SMS in: Works as expected after cold boot --------------------------------------------------------------------------------------------------------------------------------------------- PASS
SMS out: Works as expected after cold boot ------------------------------------------------------------------------------------------------------------------------------------------- PASS
Calls out: Call connects, full audio, speaker works. ----------------------------------------------------------------------------------------------------------------------------------- PASS
Calls in: Connects. Call connects, full audio (iphone and android) ------------------------------------------------------------------------------------------------------------------ PASS
Camera front: Unable to figure out how to switch to front camera ----------------------------------------------------------------------------------------------------------------- FAIL
Camera back: Super Laggy ---------------------------------------------------------------------------------------------------------------------------------------------------------------- FAIL
Loud speaker:  opening video in web browser crashed the UI ---------------------------------------------------------------------------------------------------------------------- FAIL


Build stability: Unstable


Notes: Laggy interface on boot or application start. Firefox app crashed the desktop (not the phone). Camera, super laggy.

Results: Not a suitable candidate for daily driver.

RE: My Daily Manual QA - devrtz - 07-23-2020

Regarding the front camera: You can switch to the front camera by running:
Code:
pinephone-camera-setup.sh front
pinhole - the camera app - must not be running, else you get "Device or resource busy" errors.
To switch back to the rear camera, rerun the script without arguments.

My Daily Manual QA - plainenough - 07-24-2020

Build image: mobian-pinephone-20200724.img.gz

I have limited my scope to what I consider requirements for a daily driver.  (SMS, 4G Calls, general sound quality, wifi, clock accuracy, etc. etc.)

Wifi: seems fairly stable after reboot. ----------------------------------------------------------------------------------------------------------------------------------------------------- PASS
Boot time: Changed reboot from simple restart to battery out cold boot. (~ 34s) ------------------------------------------------------------------------------------------- PASS
SMS in: Works as expected after cold boot --------------------------------------------------------------------------------------------------------------------------------------------- PASS
SMS out: Works as expected after cold boot ------------------------------------------------------------------------------------------------------------------------------------------- PASS
Calls out: Call connects, full audio, speaker works. ----------------------------------------------------------------------------------------------------------------------------------- PASS
Calls in: Connects. Call connects, full audio (iphone and android) ---------------------------------------------------------------------------------------------------------------- PASS
Camera front: Image inverted, super pixelated, not sure if HW/SW--------------------------------------------------------------------------------------------------------------- FAIL
Camera back: Super Laggy, pixelated--------------------------------------------------------------------------------------------------------------------------------------------------------- FAIL
Loud speaker:  opening video in firefox played fine ------------------------------------------------------------------------------------------------------------------------------- PASS


Build stability: More stable than previous build. No UI crashes.


Notes: Caught an update right after fresh flash and first call test. Camera, super laggy.

Results: Not a suitable candidate for daily driver. Call quality is still lacking a little bit but shouldn't affect people with average hearing abilities.  Calls and texts appear to be solid outside of the minor clairty issue on the call. Call routing works correctly. Boot time is half of ubports.

RE: My Daily Manual QA - bcnaz - 07-24-2020

Is this installed or from sd card ?
Are you using a UBPorts C.E. phone ?

Thanks

RE: My Daily Manual QA - plainenough - 07-25-2020

(07-24-2020, 06:23 PM)bcnaz Wrote: Is this installed or from sd card ?
Are you using a UBPorts C.E. phone  ?

Thanks

UBPorts CE phone. Installed on sdcard. Since I am flashing the nightly builds I figure going through SD Cards is a better option than eMMC flashing daily. Also it is way easier to recover should something go awry.

RE: My Daily Manual QA - plainenough - 07-27-2020

I have made a change to the way I will be posting these results sets. I will be uploading a report every time I execute testing and will post a link (Maybe a screenshot if preferred.)

You can check https://tosstalk.com/pinephone/ for a list of the OSes I test.

report-2020-07-27

Conclusion: Not ready to be a daily driver.

RE: My Daily Manual QA - bcnaz - 07-27-2020

Very good start to your project, however at the moment both links I clicked on led me to UBPorts July 27 reports.

RE: My Daily Manual QA - plainenough - 07-27-2020

(07-27-2020, 02:00 PM)bcnaz Wrote: Very good start to your project,  however at the moment both links I clicked on led me to UBPorts  July 27 reports.
Added a correction for that, also updated my template for clarity. Let me know if you see anything more. In the next week I plan on color coding pass and fails.

RE: My Daily Manual QA - natasha - 07-28-2020

(07-27-2020, 01:35 PM)plainenough Wrote: I have made a change to the way I will be posting these results sets. I will be uploading a report every time I execute testing and will post a link (Maybe a screenshot if preferred.)

You can check https://tosstalk.com/pinephone/ for a list of the OSes I test.

report-2020-07-27

Conclusion: Not ready to be a daily driver.

Hey, thank you for doing this! I love it!

RE: My Daily Manual QA - plainenough - 07-28-2020

Conclusion: This OS is not ready for pinephone to be a daily driver.

NOTE: I have been running on nightly development builds. Most functionality appears to work correctly on this OS out of my testing groups it is the most mature candidate.

mobian/2020-07-28