drumnbass.be forum

drumnbass.be forum » Production » Production questions & answers » MP3 listen test!!
Go to the bottom of this page MP3 listen test!!
Author
Post
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

Following up on the discussions held in the following threads:
192 kbps is enough
320kbps, 192kbps or Original

I've set up a proper listen test Big Grin

The test consists of an original wav clip (courtesy of B-Complex - Amazon Rain Bigup ) and a couple of MP3 files, encoded with LAME 3.97.

To keep the test simple all MP3's are LOW BITRATE <100KBPS!!! I tried testing using a 160kbps MP3 but was not able to tell the difference at all, that was no fun lol. Now the test is pretty easy, I had no problems identifying the MP3s from the original WAV.

BTW test works on windows only, and takes about 10-15 minutes to do.


Step 1: Installing and running
  • download the rar archive or the zip archive
  • Unpack it
  • run abchr.exe
  • file > open test file > lame_test.txt
  • tick 'show name in results file' and enter your name


Step 2: blind listen test

  • chose a part of the audio clip using the 'Portion Select Bar' at the bottom (the test is easier if you only select 1-2 seconds at a time)
  • listen to the audio and set the quality sliders accordingly
  • the 'ref' button plays the original wav file, for comparison
  • write notes about your impression of the sound quality (click on the 'paper' buttons)


Step 3: A/B/X test

  • Click on the "ABX..." button
  • select two audio files (eg 'original' and 'sample 1')
  • use the play buttons to compare
  • listen if 'X' is equal to 'A' or 'B' and fill in your choice
  • click on 'next trial' and try again!
  • try doing at least 10 tries for each sample


Step 4: post your results
  • chose file > save test results
  • open the txt file and paste your results here!


__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
23-01-2007 15:13 Homepage of thechronic
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

quote:
ABC/HR Version 1.0, 6 May 2004
Testname: LAME MP3 test Amazon Rain

Tester: thechronic

1R = 1.wav
2L = 3.wav
3L = 2.wav

---------------------------------------
General Comments:

---------------------------------------
1R File: 1.wav
1R Rating: 3.9
1R Comment: 96kbps file, lacking a bit of top end, for the rest OK
---------------------------------------
2L File: 3.wav
2L Rating: 1.0
2L Comment: yuck
---------------------------------------
3L File: 2.wav
3L Rating: 1.8
3L Comment: very bad
---------------------------------------
ABX Results:
Original vs 1.wav
8 out of 8, pval = 0.004
Original vs 3.wav
12 out of 12, pval < 0.001
Original vs 2.wav
29 out of 30, pval < 0.001


__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
23-01-2007 15:19 Homepage of thechronic
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

rudeone what have you done???? lol

Im gonna test this as soon as I get home

__
https://soundcloud.com/tsai-vidro-voves
23-01-2007 15:52 Homepage of cynik
Muad'Dib Muad'Dib is a male
Andrejnalin


images/avatars/avatar-2169.jpg

Registration Date: 02-12-2003
Posts: 4,197

Helpfulness rating: 
18 Vote(s) - Average Rating: 9.50

quote:

ABC/HR Version 1.0, 6 May 2004
Testname: LAME MP3 test Amazon Rain

Tester: Muad'Dib

1L = 3.wav
2R = 1.wav
3R = 2.wav

---------------------------------------
General Comments:
Sample 2 is exact as the Reference sample, no noticeable difference whatsover.
---------------------------------------
1L File: 3.wav
1L Rating: 1.7
1L Comment: Very bad, maybe 64kbps mp3 or even somewhat lower (if it was not VBR).
---------------------------------------
3R File: 2.wav
3R Rating: 2.4
3R Comment: Some better quality in the high end, but nothing particular. Good compression, my guess will be around 96kbps mp3, if it was not VBR, of course.
---------------------------------------
ABX Results:
Original vs 3.wav
1 out of 1, pval = 0.500
Original vs 1.wav
2 out of 3, pval = 0.500
Original vs 2.wav
10 out of 10, pval < 0.001
3.wav vs 1.wav
5 out of 5, pval = 0.031
1.wav vs 2.wav
10 out of 10, pval < 0.001


__
Thinking about becoming an Image-Line/FL Studio customer? Want a 10% reduction in price? Use this affiliate link:

http://affiliate.image-line.com/BADEBDG473

There is no such thing without its opposite
-Bene Gesserit
23-01-2007 15:54 Homepage of Muad'Dib
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

Nice one, thanks for the results Bigup

__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
23-01-2007 16:02 Homepage of thechronic
Muad'Dib Muad'Dib is a male
Andrejnalin


images/avatars/avatar-2169.jpg

Registration Date: 02-12-2003
Posts: 4,197

Helpfulness rating: 
18 Vote(s) - Average Rating: 9.50

Sure Bigup

__
Thinking about becoming an Image-Line/FL Studio customer? Want a 10% reduction in price? Use this affiliate link:

http://affiliate.image-line.com/BADEBDG473

There is no such thing without its opposite
-Bene Gesserit
23-01-2007 16:05 Homepage of Muad'Dib
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

quote:
ABC/HR Version 1.0, 6 May 2004
Testname: LAME MP3 test Amazon Rain

Tester: cynik

1R = 1.wav
2R = 2.wav
3R = 3.wav

---------------------------------------
General Comments:

---------------------------------------
1R File: 1.wav
1R Rating: 3.9
1R Comment: no sparkle as in the original
---------------------------------------
2L File: original.wav
2L Rating: 1.0
2L Comment: awful
---------------------------------------
3L File: original.wav
3L Rating: 1.8
3L Comment: beyond recognition
---------------------------------------
ABX Results:
Original vs 1.wav
10 out of 10, pval < 0.001
Original vs 2.wav
4 out of 4, pval = 0.063
Original vs 3.wav
5 out of 5, pval = 0.031


__
https://soundcloud.com/tsai-vidro-voves
23-01-2007 20:27 Homepage of cynik
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

now I see I obviusly misplaced the comments for 2 and 3, should be the other way around; 2 is worse than than 3

edit: damn, I got the comment boxes' sides all switched up too lol, where it says L or R. the numbers are right lol

ahwww to wasted for this Big Grin

anyhow, I wanna see if I was right about that first test Tongue about that sparkle thats missing on some of the buttons I clicked. but I dont see where are the results Frown

__
https://soundcloud.com/tsai-vidro-voves

This post has been edited 1 time(s), it was last edited by cynik: 23-01-2007 20:34.
23-01-2007 20:32 Homepage of cynik
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

quote:
Originally posted by cynik
anyhow, I wanna see if I was right about that first test Tongue about that sparkle thats missing on some of the buttons I clicked. but I dont see where are the results Frown

Yeah that's how I recognized it too Happy

LAME has put a low pass filter at +/- 16kHz on that sample, so it is recognizable for the missing top end.

For the rest it sounds pretty OK don't you think? Not bad for a 98kbps MP3 Big Grin

The two other sound horrible, but they are at 68kbps and 80kbps, no wonder.

__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
24-01-2007 00:37 Homepage of thechronic
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

quote:
Originally posted by thechronic
For the rest it sounds pretty OK don't you think? Not bad for a 98kbps MP3 Big Grin


Shocked that was 98kbps???? I had similar results with 160kbps using lame 3.90

__
https://soundcloud.com/tsai-vidro-voves
24-01-2007 07:06 Homepage of cynik
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

maybe you should unstick this chron, noone is paying attention

it's a very good hearing test if anything Tongue

__
https://soundcloud.com/tsai-vidro-voves
25-01-2007 14:07 Homepage of cynik
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

yeah as soon as something takes a tiny bit of effort everybody loses interest Big Grin

I found it fun to do and I learned a lot about MP3 while doing it. I made a couple of harder tests just for myself but didn't bother to upload them Smile

__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
25-01-2007 18:17 Homepage of thechronic
cynik cynik is a male
Cp6uja


Registration Date: 15-03-2005
Posts: 5,646

Helpfulness rating: 
49 Vote(s) - Average Rating: 7.86

gimme those tests!! Im hooked Big Grin

__
https://soundcloud.com/tsai-vidro-voves
25-01-2007 18:58 Homepage of cynik
Arkitekt Arkitekt is a male
Brain Fried Amen Bastard


Registration Date: 13-06-2005
Posts: 1,028

Helpfulness rating: 
11 Vote(s) - Average Rating: 7.82

ill try this again when im a little more awake (its 800am) and im not quite awake yet.

__
VIRB

DARKLAND144
DARKLAND115
27-01-2007 14:24 Homepage of Arkitekt
dmccabe dmccabe is a male
Cool Steppa


images/avatars/avatar-1048.jpg

Registration Date: 20-12-2004
Posts: 130

Helpfulness rating: 
1 Vote(s) - Average Rating: 10.00

On a mac so no test 4 me. But I would've.
Anyway, so do you guys think 128 kbps LAME is enough to play out wiith?

__
SAVE THE SL1200
28-01-2007 03:47
djfreemc djfreemc is a male
Sponsor


images/avatars/avatar-89.jpg

Registration Date: 25-07-2003
Posts: 1,117

Helpfulness rating: 
10 Vote(s) - Average Rating: 9.40

quote:
ABC/HR Version 1.0, 6 May 2004
Testname: LAME MP3 test Amazon Rain

Tester: djfreemc

1R = 2.wav
2R = 3.wav
3L = 1.wav

---------------------------------------
General Comments:

---------------------------------------
1R File: 2.wav
1R Rating: 3.6
1R Comment: highhats miss brilliance, I think I wouldn't notice without hearing the orignal just before it.
---------------------------------------
2R File: 3.wav
2R Rating: 2.0
2R Comment: lots of highs have been cutoff, sounds dull
---------------------------------------
3L File: 1.wav
3L Rating: 4.5
3L Comment: very slight difference
---------------------------------------
ABX Results:
Original vs 2.wav
1 out of 1, pval = 0.500
Original vs 1.wav
0 out of 3, pval = 1.000


__
The mysteries of the distorted snare...
Can't win if u don't play
28-01-2007 11:03 Homepage of djfreemc
thechronic thechronic is a male
admin


images/avatars/avatar-2146.jpg

Registration Date: 01-11-2002
Posts: 5,293

Helpfulness rating: 
38 Vote(s) - Average Rating: 9.68

quote:
Originally posted by dmccabe
On a mac so no test 4 me. But I would've.
Anyway, so do you guys think 128 kbps LAME is enough to play out wiith?

If it is CBR, no. If it is VBR, yes.

__
If you find spam on the site, please hit the button and select my name. I'll personally kick it to the murky depths of hell where it belongs! Devil
18-04-2007 19:56 Homepage of thechronic
drumnbass.be forum » Production » Production questions & answers » MP3 listen test!!