We have moved to a new Sailfish OS Forum. Please start new discussions there.

Revision history [back]

click to hide/show revision 1
initial version

posted 2014-01-20 16:10:13 +0200

sound quality of video recordings

Copied from #8906 to break down a multiple bug post (better to handle as separate):

  • Sound quality was a lot worse than what I expect from a 399€ phone

comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Adding an example from youtube: http://www.youtube.com/watch?v=Ux9xRt6I4I0

sound quality of video recordings

Copied from #8906 to break down a multiple bug post (better to handle as separate):

  • Sound quality was a lot worse than what I expect from a 399€ phone

From earlier, copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Adding an example from youtube: http://www.youtube.com/watch?v=Ux9xRt6I4I0

Changelog 1.0.3.8. mentioned improvements - could anyone confirm something changed?

sound quality of video recordings

Sound quality was a lot worse than what I expect from a 399€ phone

From earlier, copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Adding an example from youtube: http://www.youtube.com/watch?v=Ux9xRt6I4I0

Edit: Another Youtube example, shared 31-Jan-2014. This is propably still taken with 1.0.2.5: http://www.youtube.com/watch?v=7rT12keLUyg

Changelog 1.0.3.8. mentioned improvements - could anyone confirm something changed?

sound quality of video recordings

Sound quality was a lot worse than what I expect from a 399€ phone

From earlier, copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Adding an example from youtube: http://www.youtube.com/watch?v=Ux9xRt6I4I0

Edit: Another Youtube example, shared 31-Jan-2014. This is propably still taken with 1.0.2.5: http://www.youtube.com/watch?v=7rT12keLUyg

Changelog 1.0.3.8. mentioned improvements - could anyone confirm something changed?

sound quality of video recordings

Sound quality was a lot worse than what I expect from a 399€ phone

From earlier, copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Adding an example Examples from youtube: http://www.youtube.com/watch?v=Ux9xRt6I4I0youtube:

Edit: Another Youtube example, shared 31-Jan-2014. This is propably still taken with 1.0.2.5:

  • 1.0.0.5 or 1.0.1.10 (10-Dec-2013) http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 1.0.2.5 (31-Jan-2014) http://www.youtube.com/watch?v=7rT12keLUyg

  • 1.0.3.8 (2-Feb-2014) http://www.youtube.com/watch?v=m9lmplh0kpM
  • Changelog 1.0.3.8. mentioned improvements - could anyone confirm something changed?

sound quality of video recordings

Sound quality was a lot worse than what I expect from a 399€ phone

From earlier, copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

edit: This problem still exists in 1.0.8.19

Examples from youtube:

  • 1.0.0.5 or 1.0.1.10 (10-Dec-2013) http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 1.0.2.5 (31-Jan-2014) http://www.youtube.com/watch?v=7rT12keLUyg
  • 1.0.3.8 (2-Feb-2014) http://www.youtube.com/watch?v=m9lmplh0kpM

sound quality of video recordings

Sound quality was is a lot worse than what I expect from a 399€ phoneexpected. Examples on Youtube:

  • 2013-Dec-10 on 1.0.0.5 or 1.0.1.10 ( http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 2014-Jan-31 on 1.0.2.5 http://www.youtube.com/watch?v=7rT12keLUyg
  • 2014-Feb-2 on 1.0.3.8 http://www.youtube.com/watch?v=m9lmplh0kpM
  • 2015-May-30 on 1.0.7.16 https://youtu.be/EWo1DQwy-44

From earlier, copy Copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

edit: This problem still exists in 1.0.8.19

Examples from youtube:

  • 1.0.0.5 or 1.0.1.10 (10-Dec-2013) http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 1.0.2.5 (31-Jan-2014) http://www.youtube.com/watch?v=7rT12keLUyg
  • 1.0.3.8 (2-Feb-2014) http://www.youtube.com/watch?v=m9lmplh0kpM

sound quality of video recordings

Sound quality is a lot worse than what I expected. Examples on Youtube:

  • 2013-Dec-10 on 1.0.0.5 or 1.0.1.10 ( http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 2014-Jan-31 on 1.0.2.5 http://www.youtube.com/watch?v=7rT12keLUyg
  • 2014-Feb-2 on 1.0.3.8 http://www.youtube.com/watch?v=m9lmplh0kpM
  • 2015-May-30 on 1.0.7.16 https://youtu.be/EWo1DQwy-44

Copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Update:

I had some time to hunt this down and came up with an early conclusion. The situation has gotten even worse during system updates and currently I can only record 2-5 sec video until the sound quality drops dramatically during the recording. It seems that the issue relates to btrfs file system used on Jolla. It's rather new Linux implementation not used on too many products yet, and it's still under heavy development. Jolla's camera might be affected by the bugs in it, but there are also other possinbilities. My early conclusion of the workflow on Jolla:

  1. Video recording starts. Audio and video raw data is buffered into RAM
  2. Video data is handled by the camera, audio data with pulseaudio. Both are decoded in the CPU
  3. Writing command are sent to an mp4 file. CPU is in full use according to top
  4. While writing into the file, RAM buffer gets full of new data. Btrfs file system stalls for a while due do multiple write commands with too short time period in between
  5. RAM buffer overflows because of delayed writing and parts of the raw audio data are dropped
  6. Move to step 4... After few seconds and several write commands mp4 file is written with dramatically dropped audio quality

Possible causes and their solutions (in my suspected order):

  • Btrfs file system bugs (stalling with too severe write commands)
    • Kernel update needed. Jolla uses 3.4. branch (currently on 3.4.91, latest available 3.4.98)
  • Too slow writing speed of the internal memory
    • Video and audio quality must be downgraded to the level of the hardware performance
  • Underperforming CPU
    • Can the video raw data be decoded in the Adruino graphic chip instead of CPU leaving pulseaudio more resources?
  • Underperforming pulseaudio. Decoding code of pulseaudio (Open Source) is not resource wise.
    • Changing the decoded outcome doesn't help, tweaking the decoding method might.
  • Lack of RAM
    • This is unlikely as if the decoding is working and file writing is fast enough, any amount of free RAM should be enough. I'm just listing this option along as when the RAM buffer gets full, swap file is taken in to use on top of it being much slower in data handling.

sound quality of video recordings

Sound quality is a lot worse than what I expected. Examples on Youtube:

  • 2013-Dec-10 on 1.0.0.5 or 1.0.1.10 ( http://www.youtube.com/watch?v=Ux9xRt6I4I0
  • 2014-Jan-31 on 1.0.2.5 http://www.youtube.com/watch?v=7rT12keLUyg
  • 2014-Feb-2 on 1.0.3.8 http://www.youtube.com/watch?v=m9lmplh0kpM
  • 2015-May-30 on 1.0.7.16 https://youtu.be/EWo1DQwy-44

Copy of comment by @direc: This is just a guess, but I think that the poor audio quality on recorded video is due to active noise cancellation... At least it sounds to me like it. One could test it by completely blocking the secondary microphone...

Update:

I had some time to hunt this down and came up with an early conclusion. The situation has gotten even worse during system updates and currently I can only record 2-5 sec video until the sound quality drops dramatically during the recording. It seems that the issue relates to btrfs file system used on Jolla. It's rather new Linux implementation not used on too many products yet, and it's still under heavy development. Jolla's camera might be affected by the bugs in it, but there are also other possinbilities. My early conclusion of the workflow on Jolla:

  1. Video recording starts. Audio and video raw data is buffered into RAM
  2. Video data is handled by the camera, audio data with pulseaudio. Both are decoded in the CPU
  3. Writing command are sent to an mp4 file. CPU is in full use according to top
  4. While writing into the file, RAM buffer gets full of new data. Btrfs file system stalls for a while due do multiple write commands with too short time period in between
  5. RAM buffer overflows because of delayed writing and parts of the raw audio data are dropped
  6. Move to step 4... After few seconds and several write commands mp4 file is written with dramatically dropped audio quality

Possible causes and their solutions (in my suspected order):

  • Btrfs file system bugs (stalling with too severe write commands)
    • Kernel update needed. Jolla uses 3.4. branch (currently on 3.4.91, latest available 3.4.98)
  • Too slow writing speed of the internal memory
    • Video and audio quality must be downgraded to the level of the hardware performance
  • Underperforming CPU
    • Can the video raw data be decoded in the Adruino graphic chip instead of CPU leaving pulseaudio more resources?
  • Underperforming pulseaudio. Decoding code of pulseaudio (Open Source) is not resource wise.
    • Changing the decoded outcome doesn't help, tweaking the decoding method might.
  • Lack of RAM
    • This is unlikely as if the decoding is working and file writing is fast enough, any amount of free RAM should be enough. I'm just listing this option along as when the RAM buffer gets full, swap file is taken in to use on top of it being much slower in data handling.