MP3

From WikiProjectMed
Jump to navigation Jump to search

MP3
Filename extension.mp3
.bit (before 1995)[1]
Internet media type
  • audio/mpeg[2]
  • audio/MPA[3]
  • audio/mpa-robust[4]
Developed byKarlheinz Brandenburg, Ernst Eberlein, Heinz Gerhäuser, Bernhard Grill, Jürgen Herre and Harald Popp (all of Fraunhofer Society),[5] and others
Initial release6 December 1991; 32 years ago (1991-12-06)[6]
Latest release
ISO/IEC 13818-3:1998
April 1998; 26 years ago (1998-04)
Type of formatLossy audio
Contained byMPEG-ES
Standards
Open format?Yes[9]
Free format?Expired patents[10]

MP3 (formally MPEG-1 Audio Layer III or MPEG-2 Audio Layer III)[4] is a coding format for digital audio developed largely by the Fraunhofer Society in Germany under the lead of Karlheinz Brandenburg.[11][12] It was designed to greatly reduce the amount of data required to represent audio, yet still sound like a faithful reproduction of the original uncompressed audio to most listeners; for example, compared to CD-quality digital audio, MP3 compression can commonly achieve a 75–95% reduction in size, depending on the bit rate.[13] In popular usage, MP3 often refers to files of sound or music recordings stored in the MP3 file format (.mp3) on consumer electronic devices.

Originally defined in 1991 as the third audio format of the MPEG-1 standard, it was retained and further extended—defining additional bit rates and support for more audio channels—as the third audio format of the subsequent MPEG-2 standard. MP3 as a file format commonly designates files containing an elementary stream of MPEG-1 Audio or MPEG-2 Audio encoded data, without other complexities of the MP3 standard. Concerning audio compression, which is its most apparent element to end-users, MP3 uses lossy compression to encode data using inexact approximations and the partial discarding of data, allowing for a large reduction in file sizes when compared to uncompressed audio. The combination of small size and acceptable fidelity led to a boom in the distribution of music over the Internet in the late 1990s, with MP3 serving as an enabling technology at a time when bandwidth and storage were still at a premium. The MP3 format soon became associated with controversies surrounding copyright infringement, music piracy, and the file-ripping and sharing services MP3.com and Napster, among others. With the advent of portable media players (including "MP3 players"), a product category also including smartphones, MP3 support remains near-universal and a de facto standard for digital audio.

History

The Moving Picture Experts Group (MPEG) designed MP3 as part of its MPEG-1, and later MPEG-2, standards. MPEG-1 Audio (MPEG-1 Part 3), which included MPEG-1 Audio Layer I, II, and III, was approved as a committee draft for an ISO/IEC standard in 1991,[14][15] finalized in 1992,[16] and published in 1993 as ISO/IEC 11172-3:1993.[7] An MPEG-2 Audio (MPEG-2 Part 3) extension with lower sample and bit rates was published in 1995 as ISO/IEC 13818-3:1995.[8][17] It requires only minimal modifications to existing MPEG-1 decoders (recognition of the MPEG-2 bit in the header and addition of the new lower sample and bit rates).

Background

The MP3 lossy compression algorithm takes advantage of a perceptual limitation of human hearing called auditory masking. In 1894, the American physicist Alfred M. Mayer reported that a tone could be rendered inaudible by another tone of lower frequency.[18] In 1959, Richard Ehmer described a complete set of auditory curves regarding this phenomenon.[19] Between 1967 and 1974, Eberhard Zwicker did work in the areas of tuning and masking of critical frequency-bands,[20][21] which in turn built on the fundamental research in the area from Harvey Fletcher and his collaborators at Bell Labs.[22]

Perceptual coding was first used for speech coding compression with linear predictive coding (LPC),[23] which has origins in the work of Fumitada Itakura (Nagoya University) and Shuzo Saito (Nippon Telegraph and Telephone) in 1966.[24] In 1978, Bishnu S. Atal and Manfred R. Schroeder at Bell Labs proposed an LPC speech codec, called adaptive predictive coding, that used a psychoacoustic coding-algorithm exploiting the masking properties of the human ear.[23][25] Further optimization by Schroeder and Atal with J.L. Hall was later reported in a 1979 paper.[26] That same year, a psychoacoustic masking codec was also proposed by M. A. Krasner,[27] who published and produced hardware for speech (not usable as music bit-compression), but the publication of his results in a relatively obscure Lincoln Laboratory Technical Report[28] did not immediately influence the mainstream of psychoacoustic codec-development.

The discrete cosine transform (DCT), a type of transform coding for lossy compression, proposed by Nasir Ahmed in 1972, was developed by Ahmed with T. Natarajan and K. R. Rao in 1973; they published their results in 1974.[29][30][31] This led to the development of the modified discrete cosine transform (MDCT), proposed by J. P. Princen, A. W. Johnson and A. B. Bradley in 1987,[32] following earlier work by Princen and Bradley in 1986.[33] The MDCT later became a core part of the MP3 algorithm.[34]

Ernst Terhardt and other collaborators constructed an algorithm describing auditory masking with high accuracy in 1982.[35] This work added to a variety of reports from authors dating back to Fletcher, and to the work that initially determined critical ratios and critical bandwidths.

In 1985, Atal and Schroeder presented code-excited linear prediction (CELP), an LPC-based perceptual speech-coding algorithm with auditory masking that achieved a significant data compression ratio for its time.[23] IEEE's refereed Journal on Selected Areas in Communications reported on a wide variety of (mostly perceptual) audio compression algorithms in 1988.[36] The "Voice Coding for Communications" edition published in February 1988 reported on a wide range of established, working audio bit compression technologies,[36] some of them using auditory masking as part of their fundamental design, and several showing real-time hardware implementations.

Development

The genesis of the MP3 technology is fully described in a paper from Professor Hans Musmann,[37] who chaired the ISO MPEG Audio group for several years. In December 1988, MPEG called for an audio coding standard. In June 1989, 14 audio coding algorithms were submitted. Because of certain similarities between these coding proposals, they were clustered into four development groups. The first group was ASPEC, by Fraunhofer Gesellschaft, AT&T, France Telecom, Deutsche and Thomson-Brandt. The second group was MUSICAM, by Matsushita, CCETT, ITT and Philips. The third group was ATAC (ATRAC Coding), by Fujitsu, JVC, NEC and Sony. And the fourth group was SB-ADPCM, by NTT and BTRL.[37]

The immediate predecessors of MP3 were "Optimum Coding in the Frequency Domain" (OCF),[38] and Perceptual Transform Coding (PXFM).[39] These two codecs, along with block-switching contributions from Thomson-Brandt, were merged into a codec called ASPEC, which was submitted to MPEG, and which won the quality competition, but that was mistakenly rejected as too complex to implement. The first practical implementation of an audio perceptual coder (OCF) in hardware (Krasner's hardware was too cumbersome and slow for practical use), was an implementation of a psychoacoustic transform coder based on Motorola 56000 DSP chips.

Another predecessor of the MP3 format and technology is to be found in the perceptual codec MUSICAM based on an integer arithmetics 32 sub-bands filter bank, driven by a psychoacoustic model. It was primarily designed for Digital Audio Broadcasting (digital radio) and digital TV, and its basic principles were disclosed to the scientific community by CCETT (France) and IRT (Germany) in Atlanta during an IEEE-ICASSP conference in 1991,[40] after having worked on MUSICAM with Matsushita and Philips since 1989.[37]

This codec incorporated into a broadcasting system using COFDM modulation was demonstrated on air and in the field[41] with Radio Canada and CRC Canada during the NAB show (Las Vegas) in 1991. The implementation of the audio part of this broadcasting system was based on a two-chip encoder (one for the subband transform, one for the psychoacoustic model designed by the team of G. Stoll (IRT Germany), later known as psychoacoustic model I) and a real-time decoder using one Motorola 56001 DSP chip running an integer arithmetics software designed by Y.F. Dehery's team (CCETT, France). The simplicity of the corresponding decoder together with the high audio quality of this codec using for the first time a 48 kHz sampling rate, a 20 bits/sample input format (the highest available sampling standard in 1991, compatible with the AES/EBU professional digital input studio standard) were the main reasons to later adopt the characteristics of MUSICAM as the basic features for an advanced digital music compression codec.

During the development of the MUSICAM encoding software, Stoll and Dehery's team made thorough use of a set of high-quality audio assessment material[42] selected by a group of audio professionals from the European Broadcasting Union, and later used as a reference for the assessment of music compression codecs. The subband coding technique was found to be efficient, not only for the perceptual coding of high-quality sound materials but especially for the encoding of critical percussive sound materials (drums, triangle,...), due to the specific temporal masking effect of the MUSICAM sub-band filterbank (this advantage being a specific feature of short transform coding techniques).

As a doctoral student at Germany's University of Erlangen-Nuremberg, Karlheinz Brandenburg began working on digital music compression in the early 1980s, focusing on how people perceive music. He completed his doctoral work in 1989.[43] MP3 is directly descended from OCF and PXFM, representing the outcome of the collaboration of Brandenburg — working as a postdoctoral researcher at AT&T-Bell Labs with James D. Johnston ("JJ") of AT&T-Bell Labs — with the Fraunhofer Institute for Integrated Circuits, Erlangen (where he worked with Bernhard Grill and four other researchers – "The Original Six"[44]), with relatively minor contributions from the MP2 branch of psychoacoustic sub-band coders. In 1990, Brandenburg became an assistant professor at Erlangen-Nuremberg. While there, he continued to work on music compression with scientists at the Fraunhofer Society's Heinrich Herz Institute. In 1993, he joined the staff of Fraunhofer HHI.[43] An acapella version of the song "Tom's Diner" by Suzanne Vega was the first song used by Brandenburg to develop the MP3 format. It was used as a benchmark to see how well MP3's compression algorithm handled the human voice. Brandenburg adopted the song for testing purposes, listening to it again and again each time he refined the compression algorithm, making sure it did not adversely affect the reproduction of Vega's voice.[45] Accordingly, he dubbed Vega the "Mother of MP3".[46] Instrumental music had been easier to compress, but Vega's voice sounded unnatural in early versions of the format. Brandenburg eventually met Vega and heard Tom's Diner performed live.

Standardization

In 1991, two available proposals were assessed for an MPEG audio standard: MUSICAM (Masking pattern adapted Universal Subband Integrated Coding And Multiplexing) and ASPEC (Adaptive Spectral Perceptual Entropy Coding). The MUSICAM technique, proposed by Philips (Netherlands), CCETT (France), the Institute for Broadcast Technology (Germany), and Matsushita (Japan),[47] was chosen due to its simplicity and error robustness, as well as for its high level of computational efficiency.[48] The MUSICAM format, based on sub-band coding, became the basis for the MPEG Audio compression format, incorporating, for example, its frame structure, header format, sample rates, etc.

While much of MUSICAM technology and ideas were incorporated into the definition of MPEG Audio Layer I and Layer II, the filter bank alone and the data structure based on 1152 samples framing (file format and byte-oriented stream) of MUSICAM remained in the Layer III (MP3) format, as part of the computationally inefficient hybrid filter bank. Under the chairmanship of Professor Musmann of the Leibniz University Hannover, the editing of the standard was delegated to Leon van de Kerkhof (Netherlands), Gerhard Stoll (Germany), and Yves-François Dehery (France), who worked on Layer I and Layer II. ASPEC was the joint proposal of AT&T Bell Laboratories, Thomson Consumer Electronics, Fraunhofer Society, and CNET.[49] It provided the highest coding efficiency.

A working group consisting of van de Kerkhof, Stoll, Leonardo Chiariglione (CSELT VP for Media), Yves-François Dehery, Karlheinz Brandenburg (Germany) and James D. Johnston (United States) took ideas from ASPEC, integrated the filter bank from Layer II, added some of their ideas such as the joint stereo coding of MUSICAM and created the MP3 format, which was designed to achieve the same quality at 128 kbit/s as MP2 at 192 kbit/s.

The algorithms for MPEG-1 Audio Layer I, II and III were approved in 1991[14][15] and finalized in 1992[16] as part of MPEG-1, the first standard suite by MPEG, which resulted in the international standard ISO/IEC 11172-3 (a.k.a. MPEG-1 Audio or MPEG-1 Part 3), published in 1993.[7] Files or data streams conforming to this standard must handle sample rates of 48k, 44100, and 32k and continue to be supported by current MP3 players and decoders. Thus the first generation of MP3 defined 14 × 3 = 42 interpretations of MP3 frame data structures and size layouts.

The compression efficiency of encoders is typically defined by the bit rate because the compression ratio depends on the bit depth and sampling rate of the input signal. Nevertheless, compression ratios are often published. They may use the compact disc (CD) parameters as references (44.1 kHz, 2 channels at 16 bits per channel or 2×16 bit), or sometimes the Digital Audio Tape (DAT) SP parameters (48 kHz, 2×16 bit). Compression ratios with this latter reference are higher, which demonstrates the problem with the use of the term compression ratio for lossy encoders.

Karlheinz Brandenburg used a CD recording of Suzanne Vega's song "Tom's Diner" to assess and refine the MP3 compression algorithm.[50] This song was chosen because of its nearly monophonic nature and wide spectral content, making it easier to hear imperfections in the compression format during playbacks. This particular track has an interesting property in that the two channels are almost, but not completely, the same, leading to a case where Binaural Masking Level Depression causes spatial unmasking of noise artifacts unless the encoder properly recognizes the situation and applies corrections similar to those detailed in the MPEG-2 AAC psychoacoustic model. Some more critical audio excerpts (glockenspiel, triangle, accordion, etc.) were taken from the EBU V3/SQAM reference compact disc and have been used by professional sound engineers to assess the subjective quality of the MPEG Audio formats.[citation needed]

Going public

A reference simulation software implementation, written in the C language and later known as ISO 11172-5, was developed (in 1991–1996) by the members of the ISO MPEG Audio committee to produce bit-compliant MPEG Audio files (Layer 1, Layer 2, Layer 3). It was approved as a committee draft of the ISO/IEC technical report in March 1994 and printed as document CD 11172-5 in April 1994.[51] It was approved as a draft technical report (DTR/DIS) in November 1994,[52] finalized in 1996 and published as international standard ISO/IEC TR 11172-5:1998 in 1998.[53] The reference software in C language was later published as a freely available ISO standard.[54] Working in non-real time on several operating systems, it was able to demonstrate the first real-time hardware decoding (DSP based) of compressed audio. Some other real-time implementations of MPEG Audio encoders and decoders[55] were available for digital broadcasting (radio DAB, television DVB) towards consumer receivers and set-top boxes.

On 7 July 1994, the Fraunhofer Society released the first software MP3 encoder, called l3enc.[56] The filename extension .mp3 was chosen by the Fraunhofer team on 14 July 1995 (previously, the files had been named .bit).[1] With the first real-time software MP3 player WinPlay3 (released 9 September 1995) many people were able to encode and play back MP3 files on their PCs. Because of the relatively small hard drives of the era (≈500–1000 MB) lossy compression was essential to store multiple albums' worth of music on a home computer as full recordings (as opposed to MIDI notation, or tracker files which combined notation with short recordings of instruments playing single notes).

Fraunhofer example implementation

A hacker named SoloH discovered the source code of the "dist10" MPEG reference implementation shortly after the release on the servers of the University of Erlangen. He developed a higher-quality version and spread it on the internet. This code started the widespread CD ripping and digital music distribution as MP3 over the internet.[57][58][59][60]

Further versions

Further work on MPEG audio[61] was finalized in 1994 as part of the second suite of MPEG standards, MPEG-2, more formally known as international standard ISO/IEC 13818-3 (a.k.a. MPEG-2 Part 3 or backward compatible MPEG-2 Audio or MPEG-2 Audio BC[17]), originally published in 1995.[8][62] MPEG-2 Part 3 (ISO/IEC 13818-3) defined 42 additional bit rates and sample rates for MPEG-1 Audio Layer I, II and III. The new sampling rates are exactly half that of those originally defined in MPEG-1 Audio. This reduction in sampling rates serves to cut the available frequency fidelity in half while likewise cutting the bit rate by 50%. MPEG-2 Part 3 also enhanced MPEG-1's audio by allowing the coding of audio programs with more than two channels, up to 5.1 multichannel.[61] An MP3 coded with MPEG-2 results in half of the bandwidth reproduction of MPEG-1 appropriate for piano and singing.

A third generation of "MP3" style data streams (files) extended the MPEG-2 ideas and implementation but was named MPEG-2.5 audio since MPEG-3 already had a different meaning. This extension was developed at Fraunhofer IIS, the registered patent holder of MP3, by reducing the frame sync field in the MP3 header from 12 to 11 bits. As in the transition from MPEG-1 to MPEG-2, MPEG-2.5 adds additional sampling rates exactly half of those available using MPEG-2. It thus widens the scope of MP3 to include human speech and other applications yet requires only 25% of the bandwidth (frequency reproduction) possible using MPEG-1 sampling rates. While not an ISO-recognized standard, MPEG-2.5 is widely supported by both inexpensive Chinese and brand-name digital audio players as well as computer software-based MP3 encoders (LAME), decoders (FFmpeg) and players (MPC) adding 3 × 8 = 24 additional MP3 frame types. Each generation of MP3 thus supports 3 sampling rates exactly half that of the previous generation for a total of 9 varieties of MP3 format files. The sample rate comparison table between MPEG-1, 2, and 2.5 is given later in the article.[63][64] MPEG-2.5 is supported by LAME (since 2000), Media Player Classic (MPC), iTunes, and FFmpeg.

MPEG-2.5 was not developed by MPEG (see above) and was never approved as an international standard. MPEG-2.5 is thus an unofficial or proprietary extension to the MP3 format. It is nonetheless ubiquitous and especially advantageous for low-bit-rate human speech applications.

MPEG Audio Layer III versions
Version International Standard[*] First edition public release date Latest edition public release date
MPEG-1 Audio Layer III ISO/IEC 11172-3 Archived 28 May 2012 at the Wayback Machine (MPEG-1 Part 3)[7][15] 1993
MPEG-2 Audio Layer III ISO/IEC 13818-3 Archived 11 May 2011 at the Wayback Machine (MPEG-2 Part 3)[8][65] 1995 1998
MPEG-2.5 Audio Layer III nonstandard, Fraunhofer proprietary[63][64] 2000 2008

* The ISO standard ISO/IEC 11172-3 (a.k.a. MPEG-1 Audio) defined three formats: the MPEG-1 Audio Layer I, Layer II and Layer III. The ISO standard ISO/IEC 13818-3 (a.k.a. MPEG-2 Audio) defined an extended version of MPEG-1 Audio: MPEG-2 Audio Layer I, Layer II, and Layer III. MPEG-2 Audio (MPEG-2 Part 3) should not be confused with MPEG-2 AAC (MPEG-2 Part 7 – ISO/IEC 13818-7).[17]

LAME is the most advanced MP3 encoder.[citation needed] LAME includes a variable bit rate (VBR) encoding which uses a quality parameter rather than a bit rate goal. Later versions (2008+) support an n.nnn quality goal which automatically selects MPEG-2 or MPEG-2.5 sampling rates as appropriate for human speech recordings that need only 5512 Hz bandwidth resolution.

Internet distribution

In the second half of the 1990s, MP3 files began to spread on the Internet, often via underground pirated song networks. The first known experiment in Internet distribution was organized in the early 1990s by the Internet Underground Music Archive, better known by the acronym IUMA. After some experiments[66] using uncompressed audio files, this archive started to deliver on the native worldwide low-speed Internet some compressed MPEG Audio files using the MP2 (Layer II) format and later on used MP3 files when the standard was fully completed. The popularity of MP3s began to rise rapidly with the advent of Nullsoft's audio player Winamp, released in 1997, which still had in 2023 a community of 80 million active users.[67] In 1998, the first portable solid-state digital audio player MPMan, developed by SaeHan Information Systems, which is headquartered in Seoul, South Korea, was released and the Rio PMP300 was sold afterward in 1998, despite legal suppression efforts by the RIAA.[68]

In November 1997, the website mp3.com was offering thousands of MP3s created by independent artists for free.[68] The small size of MP3 files enabled widespread peer-to-peer file sharing of music ripped from CDs, which would have previously been nearly impossible. The first large peer-to-peer filesharing network, Napster, was launched in 1999. The ease of creating and sharing MP3s resulted in widespread copyright infringement. Major record companies argued that this free sharing of music reduced sales, and called it "music piracy". They reacted by pursuing lawsuits against Napster, which was eventually shut down and later sold, and against individual users who engaged in file sharing.[69]

Unauthorized MP3 file sharing continues on next-generation peer-to-peer networks. Some authorized services, such as Beatport, Bleep, Juno Records, eMusic, Zune Marketplace, Walmart.com, Rhapsody, the recording industry approved re-incarnation of Napster, and Amazon.com sell unrestricted music in the MP3 format.

Design

File structure

Diagram of the structure of an MP3 file
Diagram of the structure of an MP3 file (MPEG version 2.5, not described here, changes the last bit of sync word to "0" as an indication, effectively moving one bit to the version field[64]).

An MP3 file is made up of MP3 frames, which consist of a header and a data block. This sequence of frames is called an elementary stream. Due to the "bit reservoir", frames are not independent items and cannot usually be extracted on arbitrary frame boundaries. The MP3 Data blocks contain the (compressed) audio information in terms of frequencies and amplitudes. The diagram shows that the MP3 Header consists of a sync word, which is used to identify the beginning of a valid frame. This is followed by a bit indicating that this is the MPEG standard and two bits that indicate that layer 3 is used; hence MPEG-1 Audio Layer 3 or MP3. After this, the values will differ, depending on the MP3 file. ISO/IEC 11172-3 defines the range of values for each section of the header along with the specification of the header. Most MP3 files today contain ID3 metadata, which precedes or follows the MP3 frames, as noted in the diagram. The data stream can contain an optional checksum.

Joint stereo is done only on a frame-to-frame basis.[70]

Encoding and decoding

In short, MP3 compression works by reducing the accuracy of certain components of sound that are considered (by psychoacoustic analysis) to be beyond the hearing capabilities of most humans. This method is commonly referred to as perceptual coding or psychoacoustic modeling.[71] The remaining audio information is then recorded in a space-efficient manner using MDCT and FFT algorithms.

The MP3 encoding algorithm is generally split into four parts. Part 1 divides the audio signal into smaller pieces, called frames, and an MDCT filter is then performed on the output. Part 2 passes the sample into a 1024-point fast Fourier transform (FFT), then the psychoacoustic model is applied and another MDCT filter is performed on the output. Part 3 quantifies and encodes each sample, known as noise allocation, which adjusts itself to meet the bit rate and sound masking requirements. Part 4 formats the bitstream, called an audio frame, which is made up of 4 parts, the header, error check, audio data, and ancillary data.[34]

The MPEG-1 standard does not include a precise specification for an MP3 encoder but does provide examples of psychoacoustic models, rate loops, and the like in the non-normative part of the original standard.[72] MPEG-2 doubles the number of sampling rates that are supported and MPEG-2.5 adds 3 more. When this was written, the suggested implementations were quite dated. Implementers of the standard were supposed to devise algorithms suitable for removing parts of the information from the audio input. As a result, many different MP3 encoders became available, each producing files of differing quality. Comparisons were widely available, so it was easy for a prospective user of an encoder to research the best choice. Some encoders that were proficient at encoding at higher bit rates (such as LAME) were not necessarily as good at lower bit rates. Over time, LAME evolved on the SourceForge website until it became the de facto CBR MP3 encoder. Later an ABR mode was added. Work progressed on true variable bit rate using a quality goal between 0 and 10. Eventually, numbers (such as -V 9.600) could generate excellent quality low bit rate voice encoding at only 41 kbit/s using the MPEG-2.5 extensions.

MP3 uses an overlapping MDCT structure. Each MPEG-1 MP3 frame is 1152 samples, divided into two granules of 576 samples. These samples, initially in the time domain, are transformed in one block to 576 frequency-domain samples by MDCT.[73] MP3 also allows the use of shorter blocks in a granule, down to a size of 192 samples; this feature is used when a transient is detected. Doing so limits the temporal spread of quantization noise accompanying the transient (see psychoacoustics). Frequency resolution is limited by the small long block window size, which decreases coding efficiency.[70] Time resolution can be too low for highly transient signals and may cause smearing of percussive sounds.[70]

Due to the tree structure of the filter bank, pre-echo problems are made worse, as the combined impulse response of the two filter banks does not, and cannot, provide an optimum solution in time/frequency resolution.[70] Additionally, the combining of the two filter banks' outputs creates aliasing problems that must be handled partially by the "aliasing compensation" stage; however, that creates excess energy to be coded in the frequency domain, thereby decreasing coding efficiency.[74]

Decoding, on the other hand, is carefully defined in the standard. Most decoders are "bitstream compliant", which means that the decompressed output that they produce from a given MP3 file will be the same, within a specified degree of rounding tolerance, as the output specified mathematically in the ISO/IEC high standard document (ISO/IEC 11172-3). Therefore, the comparison of decoders is usually based on how computationally efficient they are (i.e., how much memory or CPU time they use in the decoding process). Over time this concern has become less of an issue as CPU clock rates transitioned from MHz to GHz. Encoder/decoder overall delay is not defined, which means there is no official provision for gapless playback. However, some encoders such as LAME can attach additional metadata that will allow players that can handle it to deliver seamless playback.

Quality

When performing lossy audio encoding, such as creating an MP3 data stream, there is a trade-off between the amount of data generated and the sound quality of the results. The person generating an MP3 selects a bit rate, which specifies how many kilobits per second of audio is desired. The higher the bit rate, the larger the MP3 data stream will be, and, generally, the closer it will sound to the original recording. With too low a bit rate, compression artifacts (i.e., sounds that were not present in the original recording) may be audible in the reproduction. Some audio is hard to compress because of its randomness and sharp attacks. When this type of audio is compressed, artifacts such as ringing or pre-echo are usually heard. A sample of applause or a triangle instrument with a relatively low bit rate provides good examples of compression artifacts. Most subjective testings of perceptual codecs tend to avoid using these types of sound materials, however, the artifacts generated by percussive sounds are barely perceptible due to the specific temporal masking feature of the 32 sub-band filterbank of Layer II on which the format is based.

Besides the bit rate of an encoded piece of audio, the quality of MP3-encoded sound also depends on the quality of the encoder algorithm as well as the complexity of the signal being encoded. As the MP3 standard allows quite a bit of freedom with encoding algorithms, different encoders do feature quite different quality, even with identical bit rates. As an example, in a public listening test featuring two early MP3 encoders set at about 128 kbit/s,[75] one scored 3.66 on a 1–5 scale, while the other scored only 2.22. Quality is dependent on the choice of encoder and encoding parameters.[76]

This observation caused a revolution in audio encoding. Early on bit rate was the prime and only consideration. At the time MP3 files were of the very simplest type: they used the same bit rate for the entire file: this process is known as constant bit rate (CBR) encoding. Using a constant bit rate makes encoding simpler and less CPU-intensive. However, it is also possible to optimize the size of the file by creating files where the bit rate changes throughout the file. These are known as variable bit rate. The bit reservoir and VBR encoding were part of the original MPEG-1 standard. The concept behind them is that, in any piece of audio, some sections are easier to compress, such as silence or music containing only a few tones, while others will be more difficult to compress. So, the overall quality of the file may be increased by using a lower bit rate for the less complex passages and a higher one for the more complex parts. With some advanced MP3 encoders, it is possible to specify a given quality, and the encoder will adjust the bit rate accordingly. Users that desire a particular "quality setting" that is transparent to their ears can use this value when encoding all of their music, and generally speaking not need to worry about performing personal listening tests on each piece of music to determine the correct bit rate.

Perceived quality can be influenced by the listening environment (ambient noise), listener attention, listener training, and in most cases by listener audio equipment (such as sound cards, speakers, and headphones). Furthermore, sufficient quality may be achieved by a lesser quality setting for lectures and human speech applications and reduces encoding time and complexity. A test given to new students by Stanford University Music Professor Jonathan Berger showed that student preference for MP3-quality music has risen each year. Berger said the students seem to prefer the 'sizzle' sounds that MP3s bring to music.[77]

An in-depth study of MP3 audio quality, sound artist and composer Ryan Maguire's project "The Ghost in the MP3" isolates the sounds lost during MP3 compression. In 2015, he released the track "moDernisT" (an anagram of "Tom's Diner"), composed exclusively from the sounds deleted during MP3 compression of the song "Tom's Diner",[78][79][80] the track originally used in the formulation of the MP3 standard. A detailed account of the techniques used to isolate the sounds deleted during MP3 compression, along with the conceptual motivation for the project, was published in the 2014 Proceedings of the International Computer Music Conference.[81]

Bit rate

MPEG Audio Layer III
available bit rates (kbit/s)[15][63][64][65][82]
MPEG-1
Audio Layer III
MPEG-2
Audio Layer III
MPEG-2.5
Audio Layer III
8 8
16 16
24 24
32 32 32
40 40 40
48 48 48
56 56 56
64 64 64
80 80
96 96
112 112
128 128
144
160 160
192
224
256
320
Supported sampling rates
by MPEG Audio Format[15][63][64][65]
MPEG-1
Audio Layer III
MPEG-2
Audio Layer III
MPEG-2.5
Audio Layer III
8 kHz
11.025 kHz
12 kHz
16 kHz
22.05 kHz
24 kHz
32 kHz
44.1 kHz
48 kHz

Bit rate is the product of the sample rate and number of bits per sample used to encode the music. CD audio is 44100 samples per second. The number of bits per sample also depends on the number of audio channels. The CD is stereo and 16 bits per channel. So, multiplying 44100 by 32 gives 1411200—the bit rate of uncompressed CD digital audio. MP3 was designed to encode this 1411 kbit/s data at 320 kbit/s or less. If less complex passages are detected by the MP3 algorithms then lower bit rates may be employed. When using MPEG-2 instead of MPEG-1, MP3 supports only lower sampling rates (16,000, 22,050, or 24,000 samples per second) and offers choices of bit rate as low as 8 kbit/s but no higher than 160 kbit/s. By lowering the sampling rate, MPEG-2 layer III removes all frequencies above half the new sampling rate that may have been present in the source audio.

As shown in these two tables, 14 selected bit rates are allowed in MPEG-1 Audio Layer III standard: 32, 40, 48, 56, 64, 80, 96, 112, 128, 160, 192, 224, 256 and 320 kbit/s, along with the 3 highest available sampling rates of 32, 44.1 and 48 kHz.[64] MPEG-2 Audio Layer III also allows 14 somewhat different (and mostly lower) bit rates of 8, 16, 24, 32, 40, 48, 56, 64, 80, 96, 112, 128, 144, 160 kbit/s with sampling rates of 16, 22.05 and 24 kHz which are exactly half that of MPEG-1.[64] MPEG-2.5 Audio Layer III frames are limited to only 8 bit rates of 8, 16, 24, 32, 40, 48, 56 and 64 kbit/s with 3 even lower sampling rates of 8, 11.025, and 12 kHz.[citation needed] On earlier systems that only support the MPEG-1 Audio Layer III standard, MP3 files with a bit rate below 32 kbit/s might be played back sped-up and pitched-up.

Earlier systems also lack fast forwarding and rewinding playback controls on MP3.[83][84]

MPEG-1 frames contain the most detail in 320 kbit/s mode, the highest allowable bit rate setting,[85] with silence and simple tones still requiring 32 kbit/s. MPEG-2 frames can capture up to 12 kHz sound reproductions needed up to 160 kbit/s. MP3 files made with MPEG-2 do not have 20 kHz bandwidth because of the Nyquist–Shannon sampling theorem. Frequency reproduction is always strictly less than half of the sampling rate, and imperfect filters require a larger margin for error (noise level versus sharpness of filter), so an 8 kHz sampling rate limits the maximum frequency to 4 kHz, while a 48 kHz sampling rate limits an MP3 to a maximum 24 kHz sound reproduction. MPEG-2 uses half and MPEG-2.5 only a quarter of MPEG-1 sample rates.

For the general field of human speech reproduction, a bandwidth of 5,512 Hz is sufficient to produce excellent results (for voice) using the sampling rate of 11,025 and VBR encoding from 44,100 (standard) WAV file. English speakers average 41–42 kbit/s with -V 9.6 setting but this may vary with the amount of silence recorded or the rate of delivery (wpm). Resampling to 12,000 (6K bandwidth) is selected by the LAME parameter -V 9.4. Likewise -V 9.2 selects a 16,000 sample rate and a resultant 8K lowpass filtering. Older versions of LAME and FFmpeg only support integer arguments for the variable bit rate quality selection parameter. The n.nnn quality parameter (-V) is documented at lame.sourceforge.net but is only supported in LAME with the new style VBR variable bit rate quality selector—not average bit rate (ABR).

A sample rate of 44.1 kHz is commonly used for music reproduction because this is also used for CD audio, the main source used for creating MP3 files. A great variety of bit rates are used on the Internet. A bit rate of 128 kbit/s is commonly used,[86] at a compression ratio of 11:1, offering adequate audio quality in a relatively small space. As Internet bandwidth availability and hard drive sizes have increased, higher bit rates up to 320 kbit/s are widespread. Uncompressed audio as stored on an audio-CD has a bit rate of 1,411.2 kbit/s, (16 bit/sample × 44,100 samples/second × 2 channels / 1,000 bits/kilobit), so the bit rates 128, 160, and 192 kbit/s represent compression ratios of approximately 11:1, 9:1 and 7:1 respectively.

Non-standard bit rates up to 640 kbit/s can be achieved with the LAME encoder and the free format option, although few MP3 players can play those files. According to the ISO standard, decoders are only required to be able to decode streams up to 320 kbit/s.[87][88][89] Early MPEG Layer III encoders used what is now called constant bit rate (CBR). The software was only able to use a uniform bit rate on all frames in an MP3 file. Later more sophisticated MP3 encoders were able to use the bit reservoir to target an average bit rate selecting the encoding rate for each frame based on the complexity of the sound in that portion of the recording.

A more sophisticated MP3 encoder can produce variable bit rate audio. MPEG audio may use bit rate switching on a per-frame basis, but only layer III decoders must support it.[64][90][91][92] VBR is used when the goal is to achieve a fixed level of quality. The final file size of a VBR encoding is less predictable than with constant bit rate. Average bit rate is a type of VBR implemented as a compromise between the two: the bit rate is allowed to vary for more consistent quality, but is controlled to remain near an average value chosen by the user, for predictable file sizes. Although an MP3 decoder must support VBR to be standards compliant, historically some decoders have bugs with VBR decoding, particularly before VBR encoders became widespread. The most evolved LAME MP3 encoder supports the generation of VBR, ABR, and even the older CBR MP3 formats.

Layer III audio can also use a "bit reservoir", a partially full frame's ability to hold part of the next frame's audio data, allowing temporary changes in effective bit rate, even in a constant bit rate stream.[64][90] Internal handling of the bit reservoir increases encoding delay.[citation needed] There is no scale factor band 21 (sfb21) for frequencies above approx 16 kHz, forcing the encoder to choose between less accurate representation in band 21 or less efficient storage in all bands below band 21, the latter resulting in wasted bit rate in VBR encoding.[93]

Ancillary data

The ancillary data field can be used to store user-defined data. The ancillary data is optional and the number of bits available is not explicitly given. The ancillary data is located after the Huffman code bits and ranges to where the next frame's main_data_begin points to. Encoder mp3PRO used ancillary data to encode extra information which could improve audio quality when decoded with its algorithm.

Metadata

A "tag" in an audio file is a section of the file that contains metadata such as the title, artist, album, track number, or other information about the file's contents. The MP3 standards do not define tag formats for MP3 files, nor is there a standard container format that would support metadata and obviate the need for tags. However, several de facto standards for tag formats exist. As of 2010, the most widespread are ID3v1 and ID3v2, and the more recently introduced APEv2. These tags are normally embedded at the beginning or end of MP3 files, separate from the actual MP3 frame data. MP3 decoders either extract information from the tags or just treat them as ignorable, non-MP3 junk data.

Playing and editing software often contains tag editing functionality, but there are also tag editor applications dedicated to the purpose. Aside from metadata about the audio content, tags may also be used for DRM.[94] ReplayGain is a standard for measuring and storing the loudness of an MP3 file (audio normalization) in its metadata tag, enabling a ReplayGain-compliant player to automatically adjust the overall playback volume for each file. MP3Gain may be used to reversibly modify files based on ReplayGain measurements so that adjusted playback can be achieved on players without ReplayGain capability.

Licensing, ownership, and legislation

The basic MP3 decoding and encoding technology is patent-free in the European Union, all patents having expired there by 2012 at the latest. In the United States, the technology became substantially patent-free on 16 April 2017 (see below). MP3 patents expired in the US between 2007 and 2017. In the past, many organizations have claimed ownership of patents related to MP3 decoding or encoding. These claims led to several legal threats and actions from a variety of sources. As a result, in countries that allow software patents, uncertainty about which patents must have been licensed to create MP3 products without committing patent infringement was common in the early stages of the technology's adoption.

The initial near-complete MPEG-1 standard (parts 1, 2, and 3) was publicly available on 6 December 1991 as ISO CD 11172.[95][96] In most countries, patents cannot be filed after prior art has been made public, and patents expire 20 years after the initial filing date, which can be up to 12 months later for filings in other countries. As a result, patents required to implement MP3 expired in most countries by December 2012, 21 years after the publication of ISO CD 11172.

An exception is the United States, where patents in force but filed before 8 June 1995 expire after the later of 17 years from the issue date or 20 years from the priority date. A lengthy patent prosecution process may result in a patent issued much later than normally expected (see submarine patents). The various MP3-related patents expired on dates ranging from 2007 to 2017 in the United States.[97] Patents for anything disclosed in ISO CD 11172 filed a year or more after its publication are questionable. If only the known MP3 patents filed by December 1992 are considered, then MP3 decoding has been patent-free in the US since 22 September 2015, when U.S. patent 5,812,672, which had a PCT filing in October 1992, expired.[98][99][100] If the longest-running patent mentioned in the aforementioned references is taken as a measure, then the MP3 technology became patent-free in the United States on 16 April 2017, when U.S. patent 6,009,399, held[101] and administered by Technicolor,[102] expired. As a result, many free and open-source software projects, such as the Fedora operating system, have decided to start shipping MP3 support by default, and users will no longer have to resort to installing unofficial packages maintained by third party software repositories for MP3 playback or encoding.[103]

Technicolor (formerly called Thomson Consumer Electronics) claimed to control MP3 licensing of the Layer 3 patents in many countries, including the United States, Japan, Canada, and EU countries.[104] Technicolor had been actively enforcing these patents.[105] MP3 license revenues from Technicolor's administration generated about €100 million for the Fraunhofer Society in 2005.[106] In September 1998, the Fraunhofer Institute sent a letter to several developers of MP3 software stating that a license was required to "distribute and/or sell decoders and/or encoders". The letter claimed that unlicensed products "infringe the patent rights of Fraunhofer and Thomson. To make, sell or distribute products using the [MPEG Layer-3] standard and thus our patents, you need to obtain a license under these patents from us."[107] This led to the situation where the LAME MP3 encoder project could not offer its users official binaries that could run on their computer. The project's position was that as source code, LAME was simply a description of how an MP3 encoder could be implemented. Unofficially, compiled binaries were available from other sources.

Sisvel S.p.A., a Luxembourg-based company, administers licenses for patents applying to MPEG Audio.[108] They, along with its United States subsidiary Audio MPEG, Inc. previously sued Thomson for patent infringement on MP3 technology,[109] but those disputes were resolved in November 2005 with Sisvel granting Thomson a license to their patents. Motorola followed soon after and signed with Sisvel to license MP3-related patents in December 2005.[110] Except for three patents, the US patents administered by Sisvel[111] had all expired in 2015. The three exceptions are: U.S. patent 5,878,080, expired February 2017; U.S. patent 5,850,456, expired February 2017; and U.S. patent 5,960,037, expired 9 April 2017. As of around the first quarter of 2023, Sisvel's licensing program has become a legacy.[112]

In September 2006, German officials seized MP3 players from SanDisk's booth at the IFA show in Berlin after an Italian patents firm won an injunction on behalf of Sisvel against SanDisk in a dispute over licensing rights. The injunction was later reversed by a Berlin judge,[113] but that reversal was in turn blocked the same day by another judge from the same court, "bringing the Patent Wild West to Germany" in the words of one commentator.[114] In February 2007, Texas MP3 Technologies sued Apple, Samsung Electronics and Sandisk in eastern Texas federal court, claiming infringement of a portable MP3 player patent that Texas MP3 said it had been assigned. Apple, Samsung, and Sandisk all settled the claims against them in January 2009.[115][116]

Alcatel-Lucent has asserted several MP3 coding and compression patents, allegedly inherited from AT&T-Bell Labs, in litigation of its own. In November 2006, before the companies' merger, Alcatel sued Microsoft for allegedly infringing seven patents. On 23 February 2007, a San Diego jury awarded Alcatel-Lucent US $1.52 billion in damages for infringement of two of them.[117] The court subsequently revoked the award, however, finding that one patent had not been infringed and that the other was not owned by Alcatel-Lucent; it was co-owned by AT&T and Fraunhofer, who had licensed it to Microsoft, the judge ruled.[118] That defense judgment was upheld on appeal in 2008.[119]

Alternative technologies

Other lossy formats exist. Among these, Advanced Audio Coding (AAC) is the most widely used, and was designed to be the successor to MP3. There also exist other lossy formats such as mp3PRO and MP2. They are members of the same technological family as MP3 and depend on roughly similar psychoacoustic models and MDCT algorithms. Whereas MP3 uses a hybrid coding approach that is part MDCT and part FFT, AAC is purely MDCT, significantly improving compression efficiency.[120] Many of the basic patents underlying these formats are held by Fraunhofer Society, Alcatel-Lucent, Thomson Consumer Electronics,[120] Bell, Dolby, LG Electronics, NEC, NTT Docomo, Panasonic, Sony Corporation,[121] ETRI, JVC Kenwood, Philips, Microsoft, and NTT.[122]

When the digital audio player market was taking off, MP3 was widely adopted as the standard hence the popular name "MP3 player". Sony was an exception and used their own ATRAC codec taken from their MiniDisc format, which Sony claimed was better.[123] Following criticism and lower than expected Walkman sales, in 2004 Sony for the first time introduced native MP3 support to its Walkman players.[124]

There are also open compression formats like Opus and Vorbis that are available free of charge and without any known patent restrictions. Some of the newer audio compression formats, such as AAC, WMA Pro, Vorbis, and Opus, are free of some limitations inherent to the MP3 format that cannot be overcome by any MP3 encoder.[97][125]

Besides lossy compression methods, lossless formats are a significant alternative to MP3 because they provide unaltered audio content, though with an increased file size compared to lossy compression. Lossless formats include FLAC (Free Lossless Audio Codec), Apple Lossless and many others.

See also

References

  1. ^ a b "Happy Birthday MP3!". Fraunhofer IIS. 12 July 2005. Archived from the original on 11 December 2014. Retrieved 18 July 2010.
  2. ^ Nilsson, M. (November 2000). "The audio/mpeg Media Type — RFC 3003". IETF. doi:10.17487/RFC3003. Archived from the original on 13 April 2012. Retrieved 7 December 2009. {{cite journal}}: Cite journal requires |journal= (help)
  3. ^ Casner, S.; Hoschka, P. (July 2003). "MIME Type Registration of RTP Payload Formats — RFC 3555". IETF. doi:10.17487/RFC3555. Archived from the original on 14 January 2012. Retrieved 7 December 2009. {{cite journal}}: Cite journal requires |journal= (help)
  4. ^ a b Finlayson, R. (February 2008). "A More Loss-Tolerant RTP Payload Format for MP3 Audio — RFC 5219". IETF. doi:10.17487/RFC5219. Archived from the original on 26 January 2021. Retrieved 4 December 2014. {{cite journal}}: Cite journal requires |journal= (help)
  5. ^ "The mp3 team". Fraunhofer IIS. Archived from the original on 14 July 2020. Retrieved 12 June 2020.
  6. ^ Patel K, Smith BC, Rowe LA (1 September 1993). "Performance of a software MPEG video decoder". Proceedings of the first ACM international conference on Multimedia - MULTIMEDIA '93. ACM Multimedia. New York City: Association for Computing Machinery. pp. 75–82. doi:10.1145/166266.166274. ISBN 978-0-89791-596-0. S2CID 3773268. Archived from the original on 15 December 2021. Retrieved 15 December 2021. Reference 3 in the paper is to Committee Draft of Standard ISO/IEC 11172, December 6, 1991.
  7. ^ a b c d "ISO/IEC 11172-3:1993 – Information technology — Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s — Part 3: Audio". ISO. 1993. Archived from the original on 28 May 2012. Retrieved 14 July 2010.
  8. ^ a b c d "ISO/IEC 13818-3:1995 – Information technology — Generic coding of moving pictures and associated audio information — Part 3: Audio". ISO. 1995. Archived from the original on 12 January 2012. Retrieved 14 July 2010.
  9. ^ "MP3 technology at Fraunhofer IIS". Fraunhofer IIS. Archived from the original on 15 August 2021. Retrieved 12 June 2020.
  10. ^ MP3 (MPEG Layer III Audio Encoding) (Full draft). Sustainability of Digital Formats. Washington, D.C.: Library of Congress. 3 May 2017. Retrieved 1 December 2021.
  11. ^ "73. "Father" of the MP3, Karlheinz Brandenburg". 13 July 2015. Archived from the original on 2 January 2023. Retrieved 2 January 2023 – via www.youtube.com.
  12. ^ "On the 20th Birthday of the MP3, An Interview With The "Father" of the MP3, Karlheinz Brandenburg". Archived from the original on 2 January 2023. Retrieved 2 January 2023.
  13. ^ "MP3 (MPEG Layer III Audio Encoding)". The Library of Congress. 27 July 2017. Archived from the original on 14 August 2017. Retrieved 9 November 2017.
  14. ^ a b ISO (November 1991). "MPEG Press Release, Kurihama, November 1991". ISO. Archived from the original on 3 May 2011. Retrieved 17 July 2010.
  15. ^ a b c d e ISO (November 1991). "CD 11172-3 – CODING OF MOVING PICTURES AND ASSOCIATED AUDIO FOR DIGITAL STORAGE MEDIA AT UP TO ABOUT 1.5 MBIT/s Part 3 AUDIO" (PDF). Archived from the original (PDF) on 30 December 2013. Retrieved 17 July 2010.
  16. ^ a b ISO (6 November 1992). "MPEG Press Release, London, 6 November 1992". Chiariglione. Archived from the original on 12 August 2010. Retrieved 17 July 2010.
  17. ^ a b c ISO (October 1998). "MPEG Audio FAQ Version 9 – MPEG-1 and MPEG-2 BC". ISO. Archived from the original on 18 February 2010. Retrieved 28 October 2009.
  18. ^ Mayer, Alfred Marshall (1894). "Researches in Acoustics". London, Edinburgh and Dublin Philosophical Magazine. 37 (226): 259–288. doi:10.1080/14786449408620544. Archived from the original on 12 September 2019. Retrieved 26 June 2019.
  19. ^ Ehmer, Richard H. (1959). "Masking by Tones Vs Noise Bands". The Journal of the Acoustical Society of America. 31 (9): 1253. Bibcode:1959ASAJ...31.1253E. doi:10.1121/1.1907853.
  20. ^ Zwicker, Eberhard (1974). "On a Psychoacoustical Equivalent of Tuning Curves". Facts and Models in Hearing. Communication and Cybernetics. Vol. 8. pp. 132–141. doi:10.1007/978-3-642-65902-7_19. ISBN 978-3-642-65904-1.
  21. ^ Zwicker, Eberhard; Feldtkeller, Richard (1999) [1967]. Das Ohr als Nachrichtenempfänger [The Ear as a Communication Receiver]. Trans. by Hannes Müsch, Søren Buus, and Mary Florentine. Archived from the original on 14 September 2000. Retrieved 29 June 2008.
  22. ^ Fletcher, Harvey (1995). Speech and Hearing in Communication. Acoustical Society of America. ISBN 978-1-56396-393-3.
  23. ^ a b c Schroeder, Manfred R. (2014). "Bell Laboratories". Acoustics, Information, and Communication: Memorial Volume in Honor of Manfred R. Schroeder. Springer. p. 388. ISBN 978-3-319-05660-9.
  24. ^ Gray, Robert M. (2010). "A History of Realtime Digital Speech on Packet Networks: Part II of Linear Predictive Coding and the Internet Protocol" (PDF). Found. Trends Signal Process. 3 (4): 203–303. doi:10.1561/2000000036. ISSN 1932-8346. Archived (PDF) from the original on 9 October 2022. Retrieved 14 July 2019.
  25. ^ Atal, B.; Schroeder, M. (1978). "Predictive coding of speech signals and subjective error criteria". ICASSP '78. IEEE International Conference on Acoustics, Speech, and Signal Processing. Vol. 3. pp. 573–576. doi:10.1109/ICASSP.1978.1170564.
  26. ^ Schroeder, M.R.; Atal, B.S.; Hall, J.L. (December 1979). "Optimizing Digital Speech Coders by Exploiting Masking Properties of the Human Ear". The Journal of the Acoustical Society of America. 66 (6): 1647. Bibcode:1979ASAJ...66.1647S. doi:10.1121/1.383662.
  27. ^ Krasner, M. A. (18 June 1979). Digital Encoding of Speech and Audio Signals Based on the Perceptual Requirements of the Auditory System (Thesis). Massachusetts Institute of Technology. hdl:1721.1/16011.
  28. ^ Krasner, M. A. (18 June 1979). "Digital Encoding of Speech Based on the Perceptual Requirement of the Auditory System (Technical Report 535)" (PDF). Archived (PDF) from the original on 3 September 2017.
  29. ^ Ahmed, Nasir (January 1991). "How I Came Up With the Discrete Cosine Transform". Digital Signal Processing. 1 (1): 4–5. Bibcode:1991DSP.....1....4A. doi:10.1016/1051-2004(91)90086-Z. Archived from the original on 10 June 2016. Retrieved 19 November 2019.
  30. ^ Ahmed, Nasir; Natarajan, T.; Rao, K. R. (January 1974), "Discrete Cosine Transform", IEEE Transactions on Computers, C-23 (1): 90–93, doi:10.1109/T-C.1974.223784, S2CID 149806273
  31. ^ Rao, K. R.; Yip, P. (1990), Discrete Cosine Transform: Algorithms, Advantages, Applications, Boston: Academic Press, ISBN 978-0-12-580203-1
  32. ^ J. P. Princen, A. W. Johnson und A. B. Bradley: Subband/transform coding using filter bank designs based on time domain aliasing cancellation, IEEE Proc. Intl. Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2161–2164, 1987
  33. ^ John P. Princen, Alan B. Bradley: Analysis/synthesis filter bank design based on time domain aliasing cancellation, IEEE Trans. Acoust. Speech Signal Processing, ASSP-34 (5), 1153–1161, 1986
  34. ^ a b Guckert, John (Spring 2012). "The Use of FFT and MDCT in MP3 Audio Compression" (PDF). University of Utah. Archived (PDF) from the original on 12 February 2021. Retrieved 14 July 2019.
  35. ^ Terhardt, E.; Stoll, G.; Seewann, M. (March 1982). "Algorithm for Extraction of Pitch and Pitch Salience from Complex Tonal Signals". The Journal of the Acoustical Society of America. 71 (3): 679. Bibcode:1982ASAJ...71..679T. doi:10.1121/1.387544.
  36. ^ a b "Voice Coding for Communications". IEEE Journal on Selected Areas in Communications. 6 (2). February 1988.
  37. ^ a b c Genesis of the MP3 Audio Coding Standard in IEEE Transactions on Consumer Electronics, IEEE, Vol. 52, Nr. 3, pp. 1043–1049, August 2006
  38. ^ Brandenburg, Karlheinz; Seitzer, Dieter (3–6 November 1988). OCF: Coding High Quality Audio with Data Rates of 64 kbit/s. 85th Convention of Audio Engineering Society. Archived from the original on 4 June 2008. Retrieved 18 March 2008.
  39. ^ Johnston, James D. (February 1988). "Transform Coding of Audio Signals Using Perceptual Noise Criteria". IEEE Journal on Selected Areas in Communications. 6 (2): 314–323. doi:10.1109/49.608.
  40. ^ Y.F. Dehery, et al. (1991) A MUSICAM source codec for Digital Audio Broadcasting and storage Proceedings IEEE-ICASSP 91 pages 3605–3608 May 1991
  41. ^ "A DAB commentary from Alan Box, EZ communication and chairman NAB DAB task force" (PDF).
  42. ^ EBU SQAM CD Sound Quality Assessment Material recordings for subjective tests. 7 October 2008. Archived from the original on 11 February 2017. Retrieved 8 February 2017.
  43. ^ a b Ewing, Jack (5 March 2007). "How MP3 Was Born". Bloomberg BusinessWeek. Archived from the original on 15 March 2016. Retrieved 24 July 2007.
  44. ^ Witt, Stephen (2016). How Music Got Free: The End of an Industry, the Turn of the Century, and the Patient Zero of Piracy. United States of America: Penguin Books. p. 13. ISBN 978-0-14-310934-1. Brandenburg and Grill were joined by four other Fraunhofer researchers. Heinz Gerhauser oversaw the institute´s audio research group; Harald Popp was a hardware specialist; Ernst Eberlein was a signal processing expert; Jurgen Herre was another graduate student whose mathematical prowess rivaled Brandenburg´s own. In later years this group would refer to themselves as "the original six".
  45. ^ Jonathan Sterne (17 July 2012). MP3: The Meaning of a Format. Duke University Press. p. 178. ISBN 978-0-8223-5287-7.
  46. ^ "Suzanne Vega | Bio". The Official Community of Suzanne Vega. Archived from the original on 18 January 2022. Retrieved 17 January 2022.
  47. ^ Digital Video and Audio Broadcasting Technology: A Practical Engineering Guide (Signals and Communication Technology) ISBN 3-540-76357-0 p. 144: "In the year 1988, the MASCAM method was developed at the Institut für Rundfunktechnik (IRT) in Munich in preparation for the digital audio broadcasting (DAB) system. From MASCAM, the MUSICAM (masking pattern universal subband integrated coding and multiplexing) method was developed in 1989 in cooperation with CCETT, Philips and Matsushita."
  48. ^ "Status report of ISO MPEG" (Press release). International Organization for Standardization. September 1990. Archived from the original on 14 February 2010.
  49. ^ "Aspec-Adaptive Spectral Entropy Coding of High Quality Music Signals". AES E-Library. 1991. Archived from the original on 11 May 2011. Retrieved 24 August 2010.
  50. ^ "The MP3: A History Of Innovation And Betrayal". NPR. 23 March 2011. Archived from the original on 3 August 2023. Retrieved 3 August 2023.
  51. ^ MPEG (25 March 1994). "Approved at 26th meeting (Paris)". Archived from the original on 26 July 2010. Retrieved 5 August 2010.
  52. ^ MPEG (11 November 1994). "Approved at 29th meeting". Archived from the original on 8 August 2010. Retrieved 5 August 2010.
  53. ^ ISO. "ISO/IEC TR 11172-5:1998 – Information technology – Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s – Part 5: Software simulation". Archived from the original on 11 May 2011. Retrieved 5 August 2010.
  54. ^ "ISO/IEC TR 11172-5:1998 – Information technology – Coding of moving pictures and associated audio for digital storage media at up to about 1,5 Mbit/s – Part 5: Software simulation (Reference Software)" (ZIP). Archived from the original on 30 December 2006. Retrieved 5 August 2010.
  55. ^ Dehery, Yves-Francois (1994). A high-quality sound coding standard for broadcasting, telecommunications and multimedia systems. The Netherlands: Elsevier Science BV. pp. 53–64. ISBN 978-0-444-81580-4. This article refers to a Musicam (MPEG Audio Layer II) compressed digital audio workstation implemented on a microcomputer used not only as a professional editing station but also as a server on Ethernet for a compressed digital audio library, therefore anticipating the future MP3 on Internet
  56. ^ "MP3 Today's Technology". Lots of Informative Information about Music. 2005. Archived from the original on 4 July 2008. Retrieved 15 September 2016.
  57. ^ The heavenly jukebox Archived 30 April 2013 at the Wayback Machine on The Atlantic "To show industries how to use the codec, MPEG cobbled together a free sample program that converted music into MP3 files. The demonstration software created poor-quality sound, and Fraunhofer did not intend that it be used. The software's "source code"—its underlying instructions—was stored on an easily accessible computer at the University of Erlangen, from which it was downloaded by one SoloH, a hacker in the Netherlands (and, one assumes, a Star Wars fan). SoloH revamped the source code to produce software that converted compact-disc tracks into music files of acceptable quality." (2000)
  58. ^ Pop Idols and Pirates: Mechanisms of Consumption and the Global Circulation ... Archived 15 October 2023 at the Wayback Machine by Dr Charles Fairchild
  59. ^ Technologies of Piracy? - Exploring the Interplay Between Commercialism and Idealism in the Development of MP3 and DivX Archived 19 September 2020 at the Wayback Machine by HENDRIK STORSTEIN SPILKER, SVEIN HÖIER, page 2072
  60. ^ www.euronet.nl/~soloh/mpegEnc/ (Archive.org)
  61. ^ a b "Adopted at 22nd WG11 meeting" (Press release). International Organization for Standardization. 2 April 1993. Archived from the original on 6 August 2010. Retrieved 18 July 2010.
  62. ^ Brandenburg, Karlheinz; Bosi, Marina (February 1997). "Overview of MPEG Audio: Current and Future Standards for Low-Bit-Rate Audio Coding". Journal of the Audio Engineering Society. 45 (1/2): 4–21. Archived from the original on 17 April 2009. Retrieved 30 June 2008.
  63. ^ a b c d "MP3 technical details (MPEG-2 and MPEG-2.5)". Fraunhofer IIS. September 2007. Archived from the original on 24 January 2008. "MPEG-2.5" is the name of a proprietary extension developed by Fraunhofer IIS. It enables MP3 to work satisfactorily at very low bitrates and introduces the additional sampling rates 8 kHz, 11.025 kHz and 12 kHz.
  64. ^ a b c d e f g h i Supurovic, Predrag (22 December 1999). "MPEG Audio Frame Header". Archived from the original on 7 September 2008. Retrieved 29 May 2009.
  65. ^ a b c "ISO/IEC 13818-3:1994(E) – Information Technology — Generic Coding of Moving Pictures and Associated Audio: Audio" (ZIP). 11 November 1994. Archived from the original on 13 June 2010. Retrieved 4 August 2010.
  66. ^ "About Internet Underground Music Archive".
  67. ^ Vainilavičius, Justinas (15 November 2023). "Winamp is back after revamp; nostalgia-inducing looks intact". cybernews. Archived from the original on 4 December 2023. Retrieved 8 December 2023.
  68. ^ a b Schubert, Ruth (10 February 1999). "Tech-savvy Getting Music For A Song; Industry Frustrated That Internet Makes Free Music Simple". Seattle Post-Intelligencer. Retrieved 22 November 2008.[permanent dead link]
  69. ^ Giesler, Markus (2008). "Conflict and Compromise: Drama in Marketplace Evolution". Journal of Consumer Research. 34 (6): 739–753. CiteSeerX 10.1.1.564.7146. doi:10.1086/522098. S2CID 145796529.
  70. ^ a b c d Bouvigne, Gabriel (2003). "MP3 Tech — Limitations". Archived from the original on 7 January 2011.
  71. ^ Jayant, Nikil; Johnston, James; Safranek, Robert (October 1993). "Signal Compression Based on Models of Human Perception". Proceedings of the IEEE. 81 (10): 1385–1422. doi:10.1109/5.241504.
  72. ^ "ISO/IEC 11172-3:1993/Cor 1:1996". International Organization for Standardization. 2006. Archived from the original on 11 May 2011. Retrieved 27 August 2009.
  73. ^ Taylor, Mark (June 2000). "LAME Technical FAQ". Archived from the original on 8 December 2023. Retrieved 9 December 2023.
  74. ^ Liberman, Serbio. DSP - The Technology Behind Multimedia.
  75. ^ Amorim, Roberto (3 August 2003). "Results of 128 kbit/s Extension Public Listening Test". Archived from the original on 27 December 2011. Retrieved 17 March 2007.
  76. ^ Mares, Sebastian (December 2005). "Results of the public multiformat listening test @ 128 kbps". Archived from the original on 21 November 2011. Retrieved 17 March 2007.
  77. ^ Dougherty, Dale (1 March 2009). "The Sizzling Sound of Music". O'Reilly Radar. Archived from the original on 20 December 2009. Retrieved 27 March 2009.
  78. ^ "Meet the Musical Clairvoyant Who Finds Ghosts In Your MP3s". NOISEY. 18 March 2015. Archived from the original on 29 April 2015. Retrieved 25 April 2015.
  79. ^ "The ghosts in the mp3". 15 March 2015. Archived from the original on 14 June 2017. Retrieved 25 April 2015.
  80. ^ "Lost and Found: U.Va. Grad Student Discovers Ghosts in the MP3". UVA Today. 23 February 2015. Archived from the original on 13 June 2015. Retrieved 25 April 2015.
  81. ^ "The Ghost in the MP3" (PDF). Archived (PDF) from the original on 12 June 2015. Retrieved 25 April 2015.
  82. ^ "Guide to command line options (in CVS)". Archived from the original on 8 April 2013. Retrieved 4 August 2010.
  83. ^ "JVC RC-EX30 operation manual" (PDF) (in multiple languages). 2004. p. 14. Archived from the original (PDF) on 20 August 2020. Search – locating a desired position on thedisc (audio CD only) (2004 boombox)
  84. ^ "DV-RW250H Operation-Manual GB" (PDF). 2004. p. 33. Archived (PDF) from the original on 20 August 2020. Retrieved 20 August 2020. • Fast forward and review playback does not work with a MP3/WMA/JPEG-CD.
  85. ^ "Sound Quality Comparison of Hi-Res Audio vs. CD vs. MP3". www.sony.com. Sony. Archived from the original on 14 September 2020. Retrieved 11 August 2020.
  86. ^ Woon-Seng Gan; Sen-Maw Kuo (2007). Embedded signal processing with the Micro Signal Architecture. Wiley-IEEE Press. p. 382. ISBN 978-0-471-73841-1. Archived from the original on 10 March 2021. Retrieved 16 November 2020.
  87. ^ Bouvigne, Gabriel (28 November 2006). "freeformat at 640 kbit/s and foobar2000, possibilities?". Archived from the original on 19 September 2016. Retrieved 15 September 2016.
  88. ^ "lame(1): create mp3 audio files - Linux man page". linux.die.net. Archived from the original on 22 August 2020. Retrieved 22 August 2020.
  89. ^ "Linux Manpages Online - man.cx manual pages". man.cx. Archived from the original on 22 August 2020. Retrieved 22 August 2020.
  90. ^ a b "GPSYCHO – Variable Bit Rate". LAME MP3 Encoder. Archived from the original on 22 April 2009. Retrieved 11 July 2009.
  91. ^ "TwoLAME: MPEG Audio Layer II VBR". Archived from the original on 3 July 2010. Retrieved 11 July 2009.
  92. ^ ISO MPEG Audio Subgroup. "MPEG Audio FAQ Version 9: MPEG-1 and MPEG-2 BC". Archived from the original on 18 February 2010. Retrieved 11 July 2009.
  93. ^ "LAME Y switch". Hydrogenaudio Knowledgebase. Archived from the original on 2 April 2015. Retrieved 23 March 2015.
  94. ^ Rae, Casey. "Metadata and You". Future of Music Coalition. Archived from the original on 29 June 2017. Retrieved 12 December 2014.
  95. ^ Patel, Ketan; Smith, Brian C.; Rowe, Lawrence A. Performance of a Software MPEG Video Decoder (PDF). ACM Multimedia 1993 Conference. Archived (PDF) from the original on 2 September 2019. Retrieved 1 July 2019.
  96. ^ "The MPEG-FAQ, Version 3.1". 14 May 1994. Archived from the original on 23 July 2009.
  97. ^ a b "A Big List of MP3 Patents (and supposed expiration dates)". tunequest. 26 February 2007. Archived from the original on 2 March 2007. Retrieved 19 March 2007.
  98. ^ Cogliati, Josh (20 July 2008). "Patent Status of MPEG-1, H.261 and MPEG-2". Kuro5hin. Archived from the original on 16 September 2008. Retrieved 6 October 2009. This work failed to consider patent divisions and continuations.
  99. ^ US Patent No. 5812672
  100. ^ "US Patent Expiration for MP3, MPEG-2, H.264". OSNews.com. Archived from the original on 2 April 2013. Retrieved 22 July 2011.
  101. ^ "Method and apparatus for encoding digital signals employing bit allocation using combinations of different threshold models to achieve desired bit rates". Archived from the original on 21 January 2023. Retrieved 21 January 2023.
  102. ^ "mp3licensing.com – Patents". mp3licensing.com. Archived from the original on 9 May 2008. Retrieved 10 May 2008.
  103. ^ "Full MP3 support coming soon to Fedora". 5 May 2017. Archived from the original on 27 June 2017. Retrieved 17 June 2017.
  104. ^ "Acoustic Data Compression – MP3 Base Patent". Foundation for a Free Information Infrastructure. 15 January 2005. Archived from the original on 15 July 2007. Retrieved 24 July 2007.
  105. ^ "Intellectual Property & Licensing". Technicolor. Archived from the original on 4 May 2011.
  106. ^ Kistenfeger, Muzinée (July 2007). "The Fraunhofer Society (Fraunhofer-Gesellschaft, FhG)". British Consulate-General Munich. Archived from the original on 18 August 2002. Retrieved 24 July 2007.
  107. ^ "Early MP3 Patent Enforcement". Chilling Effects Clearinghouse. 1 September 1998. Archived from the original on 19 August 2014. Retrieved 24 July 2007.
  108. ^ "SISVEL's MPEG Audio licensing programme". Archived from the original on 11 February 2017. Retrieved 8 February 2017.
  109. ^ "Audio MPEG and Sisvel: Thomson sued for patent infringement in Europe and the United States — MP3 players stopped by customs". ZDNet India. 6 October 2005. Archived from the original on 11 October 2007. Retrieved 24 July 2007.
  110. ^ "grants Motorola an MP3 and MPEG 2 audio patent license". SISVEL. 21 December 2005. Archived from the original on 21 January 2014. Retrieved 18 January 2014.
  111. ^ "US MPEG Audio patents" (PDF). Sisvel. Archived from the original (PDF) on 27 October 2016. Retrieved 7 April 2017.
  112. ^ "Licensing Programs - Legacy programs". www.sisvel.com. Archived from the original on 19 February 2023. Retrieved 15 September 2023.
  113. ^ Ogg, Erica (7 September 2006). "SanDisk MP3 seizure order overturned". CNET News. Archived from the original on 4 November 2012. Retrieved 24 July 2007.
  114. ^ "Sisvel brings Patent Wild West into Germany". IPEG blog. 7 September 2006. Archived from the original on 23 May 2007. Retrieved 24 July 2007.
  115. ^ "Apple, SanDisk Settle Texas MP3 Patent Spat". IP Law360. 26 January 2009. Retrieved 16 August 2010.
  116. ^ "Baker Botts LLP Professionals: Lisa Catherine Kelly — Representative Engagements". Baker Botts LLP. Archived from the original on 10 December 2014. Retrieved 15 September 2016.
  117. ^ "Microsoft faces $1.5bn MP3 payout". BBC News. 22 February 2007. Archived from the original on 2 November 2008. Retrieved 30 June 2008.
  118. ^ "Microsoft wins reversal of MP3 patent decision". CNET. 6 August 2007. Archived from the original on 30 December 2013. Retrieved 17 August 2010.
  119. ^ "Court of Appeals for the Federal Circuit Decision" (PDF). 25 September 2008. Archived from the original (PDF) on 29 October 2008.
  120. ^ a b Brandenburg, Karlheinz (1999). "MP3 and AAC Explained". Archived from the original (PDF) on 19 October 2014.
  121. ^ "Via Licensing Announces Updated AAC Joint Patent License". Business Wire. 5 January 2009. Archived from the original on 18 June 2019. Retrieved 18 June 2019.
  122. ^ "AAC Licensors". Via Corp. Archived from the original on 28 June 2019. Retrieved 6 July 2019.
  123. ^ Marriott, Michel (30 September 1999). "NEWS WATCH; New Player from Sony Will Give a Nod to MP3". The New York Times. Archived from the original on 3 July 2021. Retrieved 24 September 2020.
  124. ^ "Sony NW-E105 Network Walkman". Archived from the original on 31 October 2020. Retrieved 24 September 2020.
  125. ^ Jean-Marc Valin; Gregory Maxwell; Timothy B. Terriberry; Koen Vos (October 2013). High-Quality, Low-Delay Music Coding in the Opus Codec. 135th AES Convention. arXiv:1602.04845. Its CBR produces packets with exactly the size the encoder requested, without a bit reservoir to imposes additional buffering delays, as found in codecs such as MP3 or AAC-LD. [...] [Tonal noise] is most noticeable in low-bitrate MP3s.

Further reading