My Daily Manual QA

[User 18618]

Great to see some formal testing being performed. The Mobian maintainers are doing an excellent job focusing on usability.

[plainenough]

Great to see some formal testing being performed. The Mobian maintainers are doing an excellent job focusing on usability.

I would say semi-formal testing. To be honest I'm just a linux guy who enjoys the thought of a real OS on a phone.  I am not a mobile dev or QA guy. I agree, the mobian guys have been doing a great job.

[plainenough]

Conclusion: This OS is not ready for pinephone to be a daily driver.  (can be an experimental trial as of this build. I would expect some minor instability and ignore camera functionality though.)

NOTE: I have been running on nightly development builds. Most functionality appears to work correctly on this OS out of my testing groups it is the most mature candidate.


mobian/2020-07-29

[natasha]

Great to see some formal testing being performed. The Mobian maintainers are doing an excellent job focusing on usability.

I would say semi-formal testing. To be honest I'm just a linux guy who enjoys the thought of a real OS on a phone.  I am not a mobile dev or QA guy. I agree, the mobian guys have been doing a great job.

Many of us prefer this kind of QA, which is more informative than a very technical one.

[plainenough]

I am beginning to build a a tool that will allow me to better deliver these results, also I have recruited help from a colleague who posses a phone of the same build. We intend on expanding the qa scope soon. For now don't mind my comentary, I'm a curmudgeon. That is all.


Conclusion: This OS is not ready for the pinephone to become a daily driver.

Notes: Sorry for the late delivery, will try harder next time. SIGNIFICANT improvements to camera functionality. Kudos to the dev team. Front camera still renders upside down, might be hardware related. Audio routing works for calls. Soon to add more tests for this os and allow the stable components to fall off.

For a list of the test cases and basic steps: https://github.com/plainenough/pinehphon...asets.yaml Expect very much rough draft for this moment, but I will try to keep a list of simple steps and test cases for your viewing pleasure/questions that might come up about my methods.

mobian/2020-07-30

[bcnaz]

Have you tested the 'data' connection  ?

I think it is working software wise,  but my phone has other issues.    (Perhaps a new sim card is needed as suggested by an AT&T tech. )

I get to a web page that says:

"AT&T free message: It looks like you want to use data but you have none available. You may need to add a data package or change to a plan that supports data for your device."

So it seems I have connected to the internet, but I have carrier problems.    ( my current plan does include data )

****************
?

Speaker phone :   It worked good from my Pine phone end,  but the person I called said they heard an echo on their end while I was using speaker phone.

When I turned off speaker phone they heard me perfect.

B.C.

[plainenough]

Have you tested the 'data' connection  ?

I think it is working software wise,  but my phone has other issues.    (Perhaps a new sim card is needed as suggested by an AT&T tech. )

I get to a web page that says:

"AT&T free message: It looks like you want to use data but you have none available. You may need to add a data package or change to a plan that supports data for your device."

So it seems I have connected to the internet, but I have carrier problems.    ( my current plan does include data )

****************
?

Speaker phone :   It worked good from my Pine phone end,  but the person I called said they heard an echo on their end while I was using speaker phone.

When I turned off speaker phone they heard me perfect.

B.C.

Confirmed: Looks like my APN data didn't populate on Mobian. Checking UBports as well. But even when I manually added this in and hit a website DNS failed. Checked networking devices for any live network adapters. No configured interfaces out. No routes via IP4 or IP6. Looks like it is something they have yet to work on. I'll keep an eye on it and see what I can dig up over the weekend.  Issue looks to be Mobian specific.

Here are some links, I think these are right, but I only have a t-mobile sim at this point.

AT&T Prepaid
AT&T Contract/Regular
T-mobile Contract/Prepaid
Sprint
Rick Roll Link here
Not putting Verizon here because they are made of all the worst parts of the universe.
Verizon

I have noticed the feedback issue with the speakerphone as well. Also, every once in a while I get a report that the mic is extremely sensitive. Will begin poking at audio levels to see if we can tune a little bit.

[User 18618]

@plainenough I noticed an outlier today, which may be a testing edge case. I made a call on a stale (few days old) build of Mobian, and CRUST prematurely ended the call.

I don't know how you'd reasonably test extremes like this, but I thought it better to mention it than not.

[bcnaz]

I think the echo problem could be caused from both phones having speaker phone turned on.

In which case it gets more complicated,  if you turn down the microphone sensitivity it may reduce the echo,
   ....    but then you may have to hold the phone closer to your mouth....  hmm...
       .. >     ( You put it on speaker phone so you can set the phone down... )

---

As far as modem related problems go,
             it appears on the Brave Heart Edition   you risk corrupting the modems firmware by simply turning off your phone.

Perhaps that explains why the earlier versions of Phosh/Debian and  Mobian operating systems both worked fairly well on my phone.
  ( But when I went back to retry these previous releases,  they no longer work like they did )

   Calls in & out, and texting in & out were working.

       Now I cannot receive text.

Hopefully your UBPorts C.E. phone is more dependable...                    
                                            Your tests do give a good indication of the current state of the operating systems you test.

[bcnaz]

Not to pile on too much extra work,  but perhaps 'Hot Spot'  may be needed for some daily drivers ?

APN as per the wiki works for me.  (If you happen to use AT&T)
Name :  ATT
APN :  phone

Note :
The August 03 nightly is working fairly well now on my Brave Heat, but I did have to download Modem Manager from the onboard Software store, then simply launch it... My text app needed a kick start.