Thread: [Tutorial] Implementing the Advanced Encryption Standard

  1. #1
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444

    [Tutorial] Implementing the Advanced Encryption Standard

    Note: the latest version of this tutorial can be found at: Advanced Encryption Standard (AES) Tutorial

    To kick-start the forum being back online again, I'm starting with a tutorial about implementing the de facto standard encryption algorithm, recommended by the National Institute of Standards and Technology, which is called "Advanced Encryption Standard", or commonly referenced as AES. I'll start with a short introduction about cryptography, followed by an explanation of the algorithm, the idea and its creators. Finally, I'll guide you through all the necessary steps to implement this algorithm in C, followed by its integration into a mode of operation for block ciphers to encrypt plaintext with more than 128 bits.


    Introduction to cryptography:

    Cryptography is the science of information and communication security. (Serge Vaudenay, A classical introduction to cryptography)

    Cryptography is the science of secret codes, enabling the confidentiality of communication through an insecure channel. It protects against unauthorized parties by preventing unauthorized alteration of use. Generally speaking, it uses an cryptographic system to transform a plaintext into a ciphertext, using most of the time a key.

    One has to notice that there exist certain cipher that don't need a key at all. A famous example is ROT13 (abbreviation from Rotation 13), a simple Caesar-cipher that obscures text by replacing each letter with the letter thirteen places down in the alphabet. Since our alphabet has 26 characters, it is enough to encrypt the ciphertext again to retrieve the original message.

    Let me just mention briefly that there are secure public-key ciphers, like the famous and very secure Rivest-Shamir-Adleman (commonly called RSA) that uses a public key to encrypt a message and a secret key to decrypt it.

    Cryptography is a very important domain in computer science with many applications. The most famous example of cryptography is certainly the Enigma machine, the legendary cipher machine used by the german Third Reich to encrypt their messages, who's security breach ultimately led to the defeat of their submarine force.

    Before continuing, please read carefully the legal issues involving cryptography as in several countries even the domestic use of cryptography is prohibited:
    Cryptography has long been of interest to intelligence gathering agencies and law enforcement agencies. Because of its facilitation of privacy, and the diminution of privacy attendant on its prohibition, cryptography is also of considerable interest to civil rights supporters. Accordingly, there has been a history of controversial legal issues surrounding cryptography, especially since the advent of inexpensive computers has made possible widespread access to high quality cryptography.

    In some countries, even the domestic use of cryptography is, or has been, restricted. Until 1999, France significantly restricted the use of cryptography domestically. In China, a license is still required to use cryptography. Many countries have tight restrictions on the use of cryptography. Among the more restrictive are laws in Belarus, Kazakhstan, Mongolia, Pakistan, Russia, Singapore, Tunisia, Venezuela, and Vietnam.[31]

    In the United States, cryptography is legal for domestic use, but there has been much conflict over legal issues related to cryptography. One particularly important issue has been the export of cryptography and cryptographic software and hardware. Because of the importance of cryptanalysis in World War II and an expectation that cryptography would continue to be important for national security, many western governments have, at some point, strictly regulated export of cryptography. After World War II, it was illegal in the US to sell or distribute encryption technology overseas; in fact, encryption was classified as a munition, like tanks and nuclear weapons.[32] Until the advent of the personal computer and the Internet, this was not especially problematic. Good cryptography is indistinguishable from bad cryptography for nearly all users, and in any case, most of the cryptographic techniques generally available were slow and error prone whether good or bad. However, as the Internet grew and computers became more widely available, high quality encryption techniques became well-known around the globe. As a result, export controls came to be seen to be an impediment to commerce and to research.


    Introduction to the Advanced Encryption Standard:

    The Advanced Encryption Standard, in the following referenced as AES, is the winner of the contest, held in 1997 by the US Government, after the Data Encryption Standard was found too weak because of its small key size and the technological advancements in processor power. Fifteen candidates were accepted in 1998 and based on public comments the pool was reduced to fived finalists in 1999. In October 2000, one of these five algorithms was selected as the forthcoming standard: a slightly modified version of the Rijndael.

    The Rijndael, whose name is based on the names of its two Belgian inventors, Joan Daemen and Vicent Rijmen, is a Block cipher, which means that it works on fixed-length group of bits, which are called blocks. It takes an input block of a certain size, usually 128, and produces a corresponding output block of the same size. The transformation requires a second input, which is the secret key. It is important to know that the secret key can be of any size (depending on the cipher used) and that AES uses three different key sizes: 128, 192 and 256 bits.
    To encrypt messages longer than the block size, a mode of operation is chosen, which I will explain at the very end of this tutorial, after the implementation of AES.
    While AES supports only block sizes of 128 bits and key sizes of 128, 192 and 256 bits, the original Rijndael supports key and block sizes in any multiple of 32, with a minimum of 128 and a maximum of 256 bits.

    Further readings: Unlike DES, which is based on an Feistel network, AES is a substitution-permutation network, which is a series of mathematical operations that use substitutions (also called S-Box) and permutations (P-Boxes) and their careful definition implies that each output bit depends on every input bit.


    Description of the Advanced Encryption Standard algorithm

    AES is an iterated block cipher with a fixed block size of 128 and a variable key length. The different transformations operate on the intermediate results, called state. The state is a rectangular array of bytes and size the block size is 128 bits, which is 16 bytes, the rectangular array is of size 4x4. (In the Rijndael version with variable block size, the row size is fixed to four and the number of columns vary. The number of columns is the block size divided by 32 and denoted Nb). The cipher key is similarly pictured as a rectangular array with four rows. The number of columns of the cipher key, denoted Nk, is equal to the key length divided by 32.

    Code:
    A state:
    -----------------------------
    | a0,0 | a0,1 | a0,2 | a0,3 |
    | a1,0 | a1,1 | a1,2 | a1,3 |
    | a2,0 | a2,1 | a2,2 | a2,3 |
    | a3,0 | a3,1 | a3,2 | a3,3 |
    -----------------------------
    
    A key:
    -----------------------------
    | k0,0 | k0,1 | k0,2 | k0,3 |
    | k1,0 | k1,1 | k1,2 | k1,3 |
    | k2,0 | k2,1 | k2,2 | k2,3 |
    | k3,0 | k3,1 | k3,2 | k3,3 |
    -----------------------------
    It is very important to know that the cipher input bytes are mapped onto the the state bytes in the order a0,0, a1,0, a2,0, a3,0, a0,1, a1,1, a2,1, a3,1, a4,1 ... , and the bytes of the cipher key are mapped onto the array in the order k0,0, k1,0, k2,0, k3,0, k0,1, k1,1, k2,1, k3,1, k4,1 ... At the end of the cipher operation, the cipher output is extracted from the state by taking the state bytes in the same order.

    AES uses a variable number of rounds, which are fixed:

    A key of size 128 has 10 rounds.
    A key of size 192 has 12 rounds.
    A key of size 256 has 14 rounds.


    During each round, the following operations are applied on the state:

    1. SubBytes: every byte in the state is replaced by another one, using the Rijndael S-Box
    2. ShiftRow: every row in the 4x4 array is shifted a certain amount to the left
    3. MixColumn: a linear transformation on the columns of the state
    4. AddRoundKey: each byte of the state is combined with a round key, which is a different key for each round and derived from the Rijndael key schedule

    In the final round, the MixColumn operation is omitted.

    The algorithm looks like the following (pseudo-C):

    Code:
    AES(state, CipherKey)
    {
        KeyExpansion(CipherKey, ExpandedKey);
        AddRoundKey(state, ExpandedKey);
        for (i = 1; i < Nr; i++)
        {
            Round(state, ExpandedKey + Nb*i);
        }
        FinalRound(state, ExpandedKey + Nb * Nr);
    }
    Observations:
    • The cipher key is expanded into a larger key, which is later used for the actual operations
    • The roundKey is added to the state before starting the with loop
    • The FinalRound() is the same as Round(), apart from missing the MixColumns() operation.
    • During each round, another part of the ExpandedKey is used for the operations
    • The ExpandedKey shall ALWAYS be derived from the Cipher Key and never be specified directly.




    AES operations: SubBytes, ShiftRow, MixColumn and AddRoundKey:


    The AddRoundKey operation:
    In this operation, a Round Key is applied to the state by a simple bitwise XOR. The Round Key is derived from the Cipher Key by the means of the key schedule. The Round Key length is equal to the block key length (= 16 bytes).

    Code:
    -----------------------------       -----------------------------   -----------------------------
    | a0,0 | a0,1 | a0,2 | a0,3 |       | k0,0 | k0,1 | k0,2 | k0,3 |   | b0,0 | b0,1 | b0,2 | b0,3 |
    | a1,0 | a1,1 | a1,2 | a1,3 |  XOR  | k2,0 | k2,1 | k2,2 | k2,3 | = | b2,0 | b2,1 | b2,2 | b2,3 |
    | a2,0 | a2,1 | a2,2 | a2,3 |       | k1,0 | k1,1 | k1,2 | k1,3 |   | b1,0 | b1,1 | b1,2 | b1,3 |
    | a3,0 | a3,1 | a3,2 | a3,3 |       | k3,0 | k3,1 | k3,2 | k3,3 |   | b3,0 | b3,1 | b3,2 | b3,3 |
    -----------------------------       -----------------------------   -----------------------------
    
    where: b(i,j) = a(i,j) XOR k(i,j)
    A graphical representation of this operation can be found here.


    The ShiftRow operation:
    In this operation, each row of the state is cyclically shifted to the left, depending on the row index.

    The 1st row is shifted 0 positions to the left.
    The 2nd row is shifted 1 positions to the left.
    The 3rd row is shifted 2 positions to the left.
    The 4th row is shifted 3 positions to the left.

    Code:
    -----------------------------    -----------------------------
    | a0,0 | a0,1 | a0,2 | a0,3 |    | a0,0 | a0,1 | a0,2 | a0,3 |
    | a1,0 | a1,1 | a1,2 | a1,3 | -> | a1,1 | a0,2 | a1,3 | a1,0 |
    | a2,0 | a2,1 | a2,2 | a2,3 |    | a2,2 | a2,3 | a2,0 | a2,1 |
    | a3,0 | a3,1 | a3,2 | a3,3 |    | a3,3 | a3,0 | a3,1 | a3,2 |
    -----------------------------    -----------------------------
    A graphical representation of this operation can be found here.

    Please note that the inverse of ShiftRow is the same cyclically shift but this time to the right. It will be needed later for decoding.


    The SubBytes operation:
    The SubBytes operation is a non-linear byte substitution, operating on each byte of the state independently. The substitution table (S-Box) is invertible and is constructed by the composition of two transformations:

    • First, taking the multiplicative inverse in Rijndael's finite field.
    • Then, applying an affine transformation which is documented in the Rijndael documentation.


    Since the S-Box is independent of any input, pre-calculated forms are used, if enough memory (256 bytes for one S-Box) is available.
    Each byte of the state is then substituted by the value in the S-Box whose index corresponds to the value in the state:

    a(i,j) = SBox[a(i,j)]

    Please note that the inverse of SubBytes is the same operation, using the inversed S-Box, which is also precalculated.


    The MixColumn operation:
    I will keep this section very short since it involves a lot of very advance mathematical calculations in the Rijndael's finite field.
    All you have to know is that it corresponds to the matrix multiplication with:

    2 3 1 1
    1 2 3 1
    1 1 2 3
    3 1 1 2

    and that the addition and multiplication operations are a little different from the normal ones.
    You can skip this part if you are not interested in the math involved:
    Addition and Substraction:

    Addition and subtraction are performed by the exclusive or operation. The two operations are the same; there is no difference between addition and subtraction.
    Code:
    Multiplication in Rijndael's galois field is a little more complicated. The procedure is as follows:
    
        * Take two eight-bit numbers, a and b, and an eight-bit product p
        * Set the product to zero.
        * Make a copy of a and b, which we will simply call a and b in the rest of this algorithm
        * Run the following loop eight times:
             1. If the low bit of b is set, exclusive or the product p by the value of a
             2. Keep track of whether the high (eighth from left) bit of a is set to one
             3. Rotate a one bit to the left, discarding the high bit, and making the low bit have a value of zero
             4. If a's hi bit had a value of one prior to this rotation, exclusive or a with the hexadecimal number 0x1b
             5. Rotate b one bit to the right, discarding the low bit, and making the high (eighth from left) bit have a value of zero. 
        * The product p now has the product of a and b


    The Rijndael Key Schedule:


    The Key Schedule is responsible for expanding a short key into a larger key, whose parts are used during the different iterations. Each key size is expanded to a different size:

    An 128 bit key is expanded to an 176 byte key.
    An 192 bit key is expanded to an 208 byte key.
    An 256 bit key is expanded to an 240 byte key.

    There is a relation between the cipher key size, the number of rounds and the ExpandedKey size. For an 128-bit key, there is one initial AddRoundKey operation plus there are 10 rounds and each rounds need a new 16 byte key, therefor we require 10+1 RoundKeys of 16 byte, which equals 176 byte. The same logic can be applied to the two other cipher key sizes. The general formula is that: ExpandedKeySize = (nbrRounds+1) * BlockSize

    The Key Schedule is made up of iterations of the Key schedule core, which works on 4-byte words. The core uses a certain number of operations, which are explained here:

    Rotate:
    The 4-byte word is cyclically shifted 1 byte to the left:

    Code:
    ---------------------    ---------------------
    | 1d | 2c | 3a | 4f | -> | 2c | 3a | 4f | 1d |
    ---------------------    ---------------------

    Rcon:
    This section is again extremely mathematical and I recommend everyone who is interested to read this description. Just note that the Rcon values can be pre-calculated, which results in a simple substitution (a table lookup) in a pre-calculated, fixed Rcon table (again, Rcon can also be calculated on-the-fly if memory is a design restriction.)

    S-Box:
    The Key Schedule uses the same S-Box substitution as the main algorithm body.


    Now that we know what the operations are, let me show you the key schedule core (in pseudo-C):

    Code:
    keyScheduleCore(word)
    {
        Rotate(word);
        SBoxSubstitution(word);
        word[0] = word[0] XOR RCON[i];
    }
    In the above code, word has a size of 4 bytes and i is the iteration counter from the Key Schedule


    The Key Expansion:
    First, let me show you the keyExpansion function as you can find it in the Rijndael documentation (there are 2 version, one for key size 128, 192 and one for key size 256):

    Code:
    KeyExpansion(byte Key[4*Nk] word W[Nb*(Nr+1)])
    {
        for(i = 0; i < Nk; i++)
            W[i] = (Key[4*i],Key[4*i+1],Key[4*i+2],Key[4*i+3]);
        for(i = Nk; i < Nb * (Nr + 1); i++)
        {
            temp = W[i - 1];
            if (i &#37; Nk == 0)
                temp = SubByte(RotByte(temp)) ^ Rcon[i / Nk];
            W[i] = W[i - Nk] ^ temp;
        }
    }
    Notes:
    • Nk is the number of columns in the cipher key (128-bit -> 4, 192-bit -> 5, 256-bit -> 6)
    • W is of type "word", which is 4-bytes


    Let me try to explain this in an easier understandable way:

    • The first n bytes of the expanded key are simply the cipher key (n = the size of the encryption key)
    • The rcon value i is set to 1
    • Until we have enough bytes of expanded key, we do the following to generate n more bytes of expanded key (please note once again that "n" is used here, this varies depending on the key size)
      • we do the following to generate four bytes
        • we use a temporary 4-byte word called t
        • we assign the previous 4 bytes to t
        • we perform the key schedule core on t, with i as rcon value
        • we increment i
        • we XOR t with the 4-byte word n bytes before in the expandedKey (where n is once either either 16,24 or 32 bytes)

      • we do the following x times to generate the next x*4 bytes of the expandedKey (x = 3 for n=16,32 and x = 5 for n=24)
        • we assign the previous 4-byte word to t
        • we XOR t with the 4-byte word n bytes before in the expandedKey (where n is once either either 16,24 or 32 bytes)


      • if n = 32 (and ONLY then), we do the following to generate 4 more bytes
        • we assign the previous 4-byte word to t
        • We run each of the four bytes in t through Rijndael's S-box
        • we XOR t with the 4-byte word 32 bytes before in the expandedKey

      • if n = 32 (and ONLY then), we do the following three times to generate twelve more bytes
        • we assign the previous 4-byte word to t
        • we XOR t with the 4-byte word 32 bytes before in the expandedKey

    • We now have our expandedKey


    Don't worry if you still have problems understanding the Key Schedule, you'll see that the implementation isn't very hard. What you should note is that:
    • the part in red is only for cipher key size = 32
    • for n=16, we generate: 4 + 3*4 bytes = 16 bytes per iteration
    • for n=24, we generate: 4 + 5*4 bytes = 24 bytes per iteration
    • for n=32, we generate: 4 + 3*4 + 4 + 3*4 = 32 bytes per iteration


    The implementation of the key schedule is pretty straight forward, but since there is a lot of code repetition, it is possible to optimize the loop slightly and use the modulo operator to check when the additional operations have to be made.



    Implementation: The Key Schedule


    We will start the implementation of AES with the Cipher Key expansion. As you can read in the theoretical part above, we intend to enlarge our input cipher key, whose size varies between 128 and 256 bits into a larger key, from which different RoundKeys can be derived.
    I prefer to implement the helper functions (such as rotate, Rcon or S-Box first), test them and then move on to the larger loops. If you are not a fan of bottom-up approaches, feel free to start a little further in this tutorial and move your way up, but I felt that my approach was the more logical one here.


    Implementation: General comments

    Even though some might think that integers were the best choice to work with, since their 32 bit size best corresponds one word, I strongly discourage you from using integers. You wrongly assume that integers, or more specifically the "int" type, always has 4 bytes. However, the required ranges for signed and unsigned int are identical to those for signed and unsigned short. On compilers for 8 and 16 bit processors (including Intel x86 processors executing in 16 bit mode, such as under MS-DOS), an int is usually 16 bits and has exactly the same representation as a short. On compilers for 32 bit and larger processors (including Intel x86 processors executing in 32 bit mode, such as Win32 or Linux) an int is usually 32 bits long and has exactly the same representation as a long.

    For this very reason, we will be using unsigned chars, since the size of an char (which is called CHAR_BIT and defined in limits.h) is required to be at least 8. Jack Klein wrote: Almost all modern computers today use 8 bit bytes (technically called octets, but there are still some in production and use with other sizes, such as 9 bits. Also some processors (especially Digital Signal Processors) cannot efficiently access memory in smaller pieces than the processor's word size. There is at least one DSP I have worked with where CHAR_BIT is 32. The char types, short, int and long are all 32 bits.

    Since we want to keep our code as portable as possible and since it is up to the compiler to decide if the default type for char is signed or not, we will specify unsigned char throughout the entire code.


    Implementation: S-Box

    The S-Box values can either be calculated on-the-fly to save memory or the pre-calculated values can be stored in an array. Since I assume that every machine my code runs on will have at least 2x 256bytes (there are 2 S-Boxes, one for the encryption and one for the decryption) we will store the values in an array. Additionally, instead of accessing the values immediately from our program, I'll wrap a little function around which makes for a more readable code and would allow us to add additional code later on. Of course, this is a matter of taste, feel free to access the array immediately.

    Here's the code for the 2 S-Boxes, it's only a table-lookup that returns the value in the array whose index is specified as a parameter of the function:
    Code:
    unsigned char sbox[256] =   {
    //0     1    2      3     4    5     6     7      8    9     A      B    C     D     E     F
    0x63, 0x7c, 0x77, 0x7b, 0xf2, 0x6b, 0x6f, 0xc5, 0x30, 0x01, 0x67, 0x2b, 0xfe, 0xd7, 0xab, 0x76, //0
    0xca, 0x82, 0xc9, 0x7d, 0xfa, 0x59, 0x47, 0xf0, 0xad, 0xd4, 0xa2, 0xaf, 0x9c, 0xa4, 0x72, 0xc0, //1
    0xb7, 0xfd, 0x93, 0x26, 0x36, 0x3f, 0xf7, 0xcc, 0x34, 0xa5, 0xe5, 0xf1, 0x71, 0xd8, 0x31, 0x15, //2
    0x04, 0xc7, 0x23, 0xc3, 0x18, 0x96, 0x05, 0x9a, 0x07, 0x12, 0x80, 0xe2, 0xeb, 0x27, 0xb2, 0x75, //3
    0x09, 0x83, 0x2c, 0x1a, 0x1b, 0x6e, 0x5a, 0xa0, 0x52, 0x3b, 0xd6, 0xb3, 0x29, 0xe3, 0x2f, 0x84, //4
    0x53, 0xd1, 0x00, 0xed, 0x20, 0xfc, 0xb1, 0x5b, 0x6a, 0xcb, 0xbe, 0x39, 0x4a, 0x4c, 0x58, 0xcf, //5
    0xd0, 0xef, 0xaa, 0xfb, 0x43, 0x4d, 0x33, 0x85, 0x45, 0xf9, 0x02, 0x7f, 0x50, 0x3c, 0x9f, 0xa8, //6
    0x51, 0xa3, 0x40, 0x8f, 0x92, 0x9d, 0x38, 0xf5, 0xbc, 0xb6, 0xda, 0x21, 0x10, 0xff, 0xf3, 0xd2, //7
    0xcd, 0x0c, 0x13, 0xec, 0x5f, 0x97, 0x44, 0x17, 0xc4, 0xa7, 0x7e, 0x3d, 0x64, 0x5d, 0x19, 0x73, //8
    0x60, 0x81, 0x4f, 0xdc, 0x22, 0x2a, 0x90, 0x88, 0x46, 0xee, 0xb8, 0x14, 0xde, 0x5e, 0x0b, 0xdb, //9
    0xe0, 0x32, 0x3a, 0x0a, 0x49, 0x06, 0x24, 0x5c, 0xc2, 0xd3, 0xac, 0x62, 0x91, 0x95, 0xe4, 0x79, //A
    0xe7, 0xc8, 0x37, 0x6d, 0x8d, 0xd5, 0x4e, 0xa9, 0x6c, 0x56, 0xf4, 0xea, 0x65, 0x7a, 0xae, 0x08, //B
    0xba, 0x78, 0x25, 0x2e, 0x1c, 0xa6, 0xb4, 0xc6, 0xe8, 0xdd, 0x74, 0x1f, 0x4b, 0xbd, 0x8b, 0x8a, //C
    0x70, 0x3e, 0xb5, 0x66, 0x48, 0x03, 0xf6, 0x0e, 0x61, 0x35, 0x57, 0xb9, 0x86, 0xc1, 0x1d, 0x9e, //D
    0xe1, 0xf8, 0x98, 0x11, 0x69, 0xd9, 0x8e, 0x94, 0x9b, 0x1e, 0x87, 0xe9, 0xce, 0x55, 0x28, 0xdf, //E
    0x8c, 0xa1, 0x89, 0x0d, 0xbf, 0xe6, 0x42, 0x68, 0x41, 0x99, 0x2d, 0x0f, 0xb0, 0x54, 0xbb, 0x16 }; //F
    
    unsigned char rsbox[256] =
    { 0x52, 0x09, 0x6a, 0xd5, 0x30, 0x36, 0xa5, 0x38, 0xbf, 0x40, 0xa3, 0x9e, 0x81, 0xf3, 0xd7, 0xfb
    , 0x7c, 0xe3, 0x39, 0x82, 0x9b, 0x2f, 0xff, 0x87, 0x34, 0x8e, 0x43, 0x44, 0xc4, 0xde, 0xe9, 0xcb
    , 0x54, 0x7b, 0x94, 0x32, 0xa6, 0xc2, 0x23, 0x3d, 0xee, 0x4c, 0x95, 0x0b, 0x42, 0xfa, 0xc3, 0x4e
    , 0x08, 0x2e, 0xa1, 0x66, 0x28, 0xd9, 0x24, 0xb2, 0x76, 0x5b, 0xa2, 0x49, 0x6d, 0x8b, 0xd1, 0x25
    , 0x72, 0xf8, 0xf6, 0x64, 0x86, 0x68, 0x98, 0x16, 0xd4, 0xa4, 0x5c, 0xcc, 0x5d, 0x65, 0xb6, 0x92
    , 0x6c, 0x70, 0x48, 0x50, 0xfd, 0xed, 0xb9, 0xda, 0x5e, 0x15, 0x46, 0x57, 0xa7, 0x8d, 0x9d, 0x84
    , 0x90, 0xd8, 0xab, 0x00, 0x8c, 0xbc, 0xd3, 0x0a, 0xf7, 0xe4, 0x58, 0x05, 0xb8, 0xb3, 0x45, 0x06
    , 0xd0, 0x2c, 0x1e, 0x8f, 0xca, 0x3f, 0x0f, 0x02, 0xc1, 0xaf, 0xbd, 0x03, 0x01, 0x13, 0x8a, 0x6b
    , 0x3a, 0x91, 0x11, 0x41, 0x4f, 0x67, 0xdc, 0xea, 0x97, 0xf2, 0xcf, 0xce, 0xf0, 0xb4, 0xe6, 0x73
    , 0x96, 0xac, 0x74, 0x22, 0xe7, 0xad, 0x35, 0x85, 0xe2, 0xf9, 0x37, 0xe8, 0x1c, 0x75, 0xdf, 0x6e
    , 0x47, 0xf1, 0x1a, 0x71, 0x1d, 0x29, 0xc5, 0x89, 0x6f, 0xb7, 0x62, 0x0e, 0xaa, 0x18, 0xbe, 0x1b
    , 0xfc, 0x56, 0x3e, 0x4b, 0xc6, 0xd2, 0x79, 0x20, 0x9a, 0xdb, 0xc0, 0xfe, 0x78, 0xcd, 0x5a, 0xf4
    , 0x1f, 0xdd, 0xa8, 0x33, 0x88, 0x07, 0xc7, 0x31, 0xb1, 0x12, 0x10, 0x59, 0x27, 0x80, 0xec, 0x5f
    , 0x60, 0x51, 0x7f, 0xa9, 0x19, 0xb5, 0x4a, 0x0d, 0x2d, 0xe5, 0x7a, 0x9f, 0x93, 0xc9, 0x9c, 0xef
    , 0xa0, 0xe0, 0x3b, 0x4d, 0xae, 0x2a, 0xf5, 0xb0, 0xc8, 0xeb, 0xbb, 0x3c, 0x83, 0x53, 0x99, 0x61
    , 0x17, 0x2b, 0x04, 0x7e, 0xba, 0x77, 0xd6, 0x26, 0xe1, 0x69, 0x14, 0x63, 0x55, 0x21, 0x0c, 0x7d };
    
    unsigned char getSBoxValue(unsigned char num)
    {
        return sbox[num];
    }
    
    unsigned char getSBoxInvert(unsigned char num)
    {
        return rsbox[num];
    }

    Implementation: Rotate

    From the theoretical part, you should know already that Rotate takes a word (a 4-byte array) and rotates it 8 bit to the left. Since 8 bit correspond to one byte and our array type is character (whose size is one byte), rotating 8 bit to the left corresponds to shifting cyclically the array values one to the left.

    Here's the code for the Rotate function:
    Code:
    /* Rijndael's key schedule rotate operation
     * rotate the word eight bits to the left
     *
     * rotate(1d2c3a4f) = 2c3a4f1d
     *
     * word is an char array of size 4 (32 bit)
     */
    void rotate(unsigned char *word)
    {
        unsigned char c;
        int i;
    
        c = word[0];
        for (i = 0; i < 3; i++)
            word[i] = word[i+1];
        word[3] = c;
    }

    Implementation: Rcon

    Same as with the S-Box, the Rcon values can be calculated on-the-fly but once again I decide to store them in an array since they only require 255 bytes of space. To keep in line with the S-Box implementation, I write a little access function.

    Here's the code for Rcon:

    Code:
    unsigned char Rcon[255] = {
    
    0x8d, 0x01, 0x02, 0x04, 0x08, 0x10, 0x20, 0x40, 0x80, 0x1b, 0x36, 0x6c, 0xd8,
    0xab, 0x4d, 0x9a, 0x2f, 0x5e, 0xbc, 0x63, 0xc6, 0x97, 0x35, 0x6a, 0xd4, 0xb3,
    0x7d, 0xfa, 0xef, 0xc5, 0x91, 0x39, 0x72, 0xe4, 0xd3, 0xbd, 0x61, 0xc2, 0x9f,
    0x25, 0x4a, 0x94, 0x33, 0x66, 0xcc, 0x83, 0x1d, 0x3a, 0x74, 0xe8, 0xcb, 0x8d,
    0x01, 0x02, 0x04, 0x08, 0x10, 0x20, 0x40, 0x80, 0x1b, 0x36, 0x6c, 0xd8, 0xab,
    0x4d, 0x9a, 0x2f, 0x5e, 0xbc, 0x63, 0xc6, 0x97, 0x35, 0x6a, 0xd4, 0xb3, 0x7d,
    0xfa, 0xef, 0xc5, 0x91, 0x39, 0x72, 0xe4, 0xd3, 0xbd, 0x61, 0xc2, 0x9f, 0x25,
    0x4a, 0x94, 0x33, 0x66, 0xcc, 0x83, 0x1d, 0x3a, 0x74, 0xe8, 0xcb, 0x8d, 0x01,
    0x02, 0x04, 0x08, 0x10, 0x20, 0x40, 0x80, 0x1b, 0x36, 0x6c, 0xd8, 0xab, 0x4d,
    0x9a, 0x2f, 0x5e, 0xbc, 0x63, 0xc6, 0x97, 0x35, 0x6a, 0xd4, 0xb3, 0x7d, 0xfa,
    0xef, 0xc5, 0x91, 0x39, 0x72, 0xe4, 0xd3, 0xbd, 0x61, 0xc2, 0x9f, 0x25, 0x4a,
    0x94, 0x33, 0x66, 0xcc, 0x83, 0x1d, 0x3a, 0x74, 0xe8, 0xcb, 0x8d, 0x01, 0x02,
    0x04, 0x08, 0x10, 0x20, 0x40, 0x80, 0x1b, 0x36, 0x6c, 0xd8, 0xab, 0x4d, 0x9a,
    0x2f, 0x5e, 0xbc, 0x63, 0xc6, 0x97, 0x35, 0x6a, 0xd4, 0xb3, 0x7d, 0xfa, 0xef,
    0xc5, 0x91, 0x39, 0x72, 0xe4, 0xd3, 0xbd, 0x61, 0xc2, 0x9f, 0x25, 0x4a, 0x94,
    0x33, 0x66, 0xcc, 0x83, 0x1d, 0x3a, 0x74, 0xe8, 0xcb, 0x8d, 0x01, 0x02, 0x04,
    0x08, 0x10, 0x20, 0x40, 0x80, 0x1b, 0x36, 0x6c, 0xd8, 0xab, 0x4d, 0x9a, 0x2f,
    0x5e, 0xbc, 0x63, 0xc6, 0x97, 0x35, 0x6a, 0xd4, 0xb3, 0x7d, 0xfa, 0xef, 0xc5,
    0x91, 0x39, 0x72, 0xe4, 0xd3, 0xbd, 0x61, 0xc2, 0x9f, 0x25, 0x4a, 0x94, 0x33,
    0x66, 0xcc, 0x83, 0x1d, 0x3a, 0x74, 0xe8, 0xcb};
    
    unsigned char getRconValue(unsigned char num)
    {
        return Rcon[num];
    }

    Implementation: Key Schedule Core

    The implementation of the Key Schedule Core from the pseudo-C is pretty easy. All the code does is apply the operations one after the other on the 4-byte word. The parameters are the 4-byte word and the iteration counter, on which Rcon depends.

    Code:
    void core(unsigned char *word, int iteration)
    {
        int i;
        
        /* rotate the 32-bit word 8 bits to the left */
        rotate(word);
                
        /* apply S-Box substitution on all 4 parts of the 32-bit word */
        for (i = 0; i < 4; ++i)
        {
            word[i] = getSBoxValue(word[i]);
        }
        
        /* XOR the output of the rcon operation with i to the first part (leftmost) only */
        word[0] = word[0]^getRconValue(iteration);
    }

    Implementation: Key Expansion

    The Key Expansion is where it all comes together. As you can see in the pretty big list in the theory about the Rijndael Key Expansion, we need to apply several operations a number of times, depending on they key size.
    As the key size can only take a very limited number of values, I decided to implement it as an enumeration type. Not only does that limit the key size to only three possible values, it also makes the code more readable.

    Code:
    enum keySize{
        SIZE_16 = 16,
        SIZE_24 = 24,
        SIZE_32 = 32
        };
    Our key expansion function basically needs only two things:
    • the input cipher key
    • the output expanded key


    Since in C, it is not possible to know the size of an array passed as pointer to a function, we'll add the cipher key size (of type "enum keySize") and the expanded key size (of type size_t) to the parameter list of our function. The prototype looks like the following:

    Code:
    void expandKey(unsigned char *expandedKey, unsigned char *key, enum keySize, size_t expandedKeySize);
    While implementing the function, I try to follow the details in the theoretical list as close as possible. As I already explained, since several parts of the code are repeated, I'll try to get rid of the code repetition and use conditions to see when I need to use a certain operation.

    Instead of writing:
    Code:
    while (expanded_key_size < required_key_size)
    {
        key_schedule_core(word);
        for (i=0; i<4; i++)
            some_operation();
    }
    I'll use a different structure:
    Code:
    while (expanded_key_size < required_key_size)
    {
        if (expanded_key_size%key_size == 0)
            key_schedule_core(word);
        some_operation();
    }
    This structure comes down to the same thing, but allows me to be more flexible when it comes to add the 256-bit cipherkey version that has those additional steps.

    Let me show you the keyexpansion function and give explanations later on:

    Code:
    /* Rijndael's key expansion 
     * expands an 128,192,256 key into an 176,208,240 bytes key
     *
     * expandedKey is a pointer to an char array of large enough size
     * key is a pointer to a non-expanded key
     */
    
    void expandKey(unsigned char *expandedKey, unsigned char *key, enum keySize size, size_t expandedKeySize)
    {
        /* current expanded keySize, in bytes */
        int currentSize = 0;
        int rconIteration = 1;
        int i;
        unsigned char t[4] = {0};   // temporary 4-byte variable
        
        /* set the 16,24,32 bytes of the expanded key to the input key */
        for (i = 0; i < size; i++)
            expandedKey[i] = key[i];
        currentSize += size;
        
        while (currentSize < expandedKeySize)
        {
            /* assign the previous 4 bytes to the temporary value t */
            for (i = 0; i < 4; i++)
            {
                t[i] = expandedKey[(currentSize - 4) + i];
            }
            
            /* every 16,24,32 bytes we apply the core schedule to t and increment rconIteration afterwards */
            if(currentSize % size == 0)
            {
                core(t, rconIteration++);
            }
    
            /* For 256-bit keys, we add an extra sbox to the calculation */
            if(size == SIZE_32 && ((currentSize % size) == 16)) {
                for(i = 0; i < 4; i++) 
                    t[i] = getSBoxValue(t[i]);
            }
            
            /* We XOR t with the four-byte block 16,24,32 bytes before the new expanded key.
             * This becomes the next four bytes in the expanded key.
             */
            for(i = 0; i < 4; i++) {
                expandedKey[currentSize] = expandedKey[currentSize - size] ^ t[i];
                currentSize++;
            }
        }
    }
    As you can see, I never use inner loops to repeat an operation, the only inner loops are to iterate over the 4 parts of the temporary array t. I use the modulo operator to check if I need to apply the operation:
    • if(currentSize % size == 0): whenever we have have created n bytes of expandedKey (where n is the cipherkey size), we run the key expansion core once
    • if(size == SIZE_32 && ((currentSize % size) == 16)): if we are expanding an 32-bit cipherkey and if we have already generated 16 bytes (as I explained above, in the 32-bit version we run the first loop only 3 times, which generates 12 bytes + the 4 bytes from the core), we add one additional S-Box substitution



    Implementation: Using the Key Expansion

    Finally, we can test our newly created key expansion. I won't calculate the expandedKey size just yet but rather give it a fixed value (the calculation requires the number of rounds which isn't needed at this point). Here's the code that would expand a given cipher key:

    Code:
        /* the expanded keySize */
        int expandedKeySize = 176;
    
        /* the expanded key */
        unsigned char expandedKey[expandedKeySize];
    
        /* the cipher key */
        unsigned char key[16] = {0};
    
        /* the cipher key size */
        enum keySize size = SIZE_16;
    
        int i;
    
        expandKey(expandedKey, key, size, expandedKeySize);
    
        printf("Expanded Key:\n");
        for (i = 0; i < expandedKeySize; i++)
        {
                printf("%2.2x%c", expandedKey[i], (i%16) ? '\n' : ' ');
        }
    Of course, this code uses several constants that will be generated automatically once we implement the body of the AES encryption.
    Here are several test results:

    The Key Expansion of an 128-bit key consisting of null characters (like the example above):
    Code:
    00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
    62 63 63 63 62 63 63 63 62 63 63 63 62 63 63 63 
    9b 98 98 c9 f9 fb fb aa 9b 98 98 c9 f9 fb fb aa 
    90 97 34 50 69 6c cf fa f2 f4 57 33 0b 0f ac 99 
    ee 06 da 7b 87 6a 15 81 75 9e 42 b2 7e 91 ee 2b 
    7f 2e 2b 88 f8 44 3e 09 8d da 7c bb f3 4b 92 90 
    ec 61 4b 85 14 25 75 8c 99 ff 09 37 6a b4 9b a7 
    21 75 17 87 35 50 62 0b ac af 6b 3c c6 1b f0 9b 
    0e f9 03 33 3b a9 61 38 97 06 0a 04 51 1d fa 9f 
    b1 d4 d8 e2 8a 7d b9 da 1d 7b b3 de 4c 66 49 41 
    b4 ef 5b cb 3e 92 e2 11 23 e9 51 cf 6f 8f 18 8e
    The Key Expansion of an 192-bit key consisting of null characters:
    Code:
    00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
    00 00 00 00 00 00 00 00 62 63 63 63 62 63 63 63 
    62 63 63 63 62 63 63 63 62 63 63 63 62 63 63 63 
    9b 98 98 c9 f9 fb fb aa 9b 98 98 c9 f9 fb fb aa 
    9b 98 98 c9 f9 fb fb aa 90 97 34 50 69 6c cf fa 
    f2 f4 57 33 0b 0f ac 99 90 97 34 50 69 6c cf fa 
    c8 1d 19 a9 a1 71 d6 53 53 85 81 60 58 8a 2d f9 
    c8 1d 19 a9 a1 71 d6 53 7b eb f4 9b da 9a 22 c8 
    89 1f a3 a8 d1 95 8e 51 19 88 97 f8 b8 f9 41 ab 
    c2 68 96 f7 18 f2 b4 3f 91 ed 17 97 40 78 99 c6 
    59 f0 0e 3e e1 09 4f 95 83 ec bc 0f 9b 1e 08 30 
    0a f3 1f a7 4a 8b 86 61 13 7b 88 5f f2 72 c7 ca 
    43 2a c8 86 d8 34 c0 b6 d2 c7 df 11 98 4c 59 70
    The Key Expansion of an 256-bit key consisting of null characters:
    Code:
    00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
    00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 
    62 63 63 63 62 63 63 63 62 63 63 63 62 63 63 63 
    aa fb fb fb aa fb fb fb aa fb fb fb aa fb fb fb 
    6f 6c 6c cf 0d 0f 0f ac 6f 6c 6c cf 0d 0f 0f ac 
    7d 8d 8d 6a d7 76 76 91 7d 8d 8d 6a d7 76 76 91 
    53 54 ed c1 5e 5b e2 6d 31 37 8e a2 3c 38 81 0e 
    96 8a 81 c1 41 fc f7 50 3c 71 7a 3a eb 07 0c ab 
    9e aa 8f 28 c0 f1 6d 45 f1 c6 e3 e7 cd fe 62 e9 
    2b 31 2b df 6a cd dc 8f 56 bc a6 b5 bd bb aa 1e 
    64 06 fd 52 a4 f7 90 17 55 31 73 f0 98 cf 11 19 
    6d bb a9 0b 07 76 75 84 51 ca d3 31 ec 71 79 2f 
    e7 b0 e8 9c 43 47 78 8b 16 76 0b 7b 8e b9 1a 62 
    74 ed 0b a1 73 9b 7e 25 22 51 ad 14 ce 20 d4 3b 
    10 f8 0a 17 53 bf 72 9c 45 c9 79 e7 cb 70 63 85


    Implementation: AES Encryption
    to be continued...
    Last edited by laserlight; 11-23-2007 at 01:53 PM. Reason: Added external link on request of the author.

  2. #2
    Registered User
    Join Date
    Sep 2006
    Posts
    8,868
    Excellent! That post about the Enigma Machine last week, peaked my curiosity.

    Throughout the pre-industrial age, I have learned, since communications involved messengers who could always be easily intercepted (for the most part), and not perfectly trusted, the art of "secret writing" was quite important.

    Thanks, KONI. I look forward to your other installments. :P

    Adak

  3. #3
    Registered User
    Join Date
    Nov 2006
    Posts
    65
    awesome post *votes to move to official Tutorial section*.
    You rant and rave about it, but at the end of the day, it doesn't matter if people use it as long as you don't see.
    People are free to read the arguments, but if the only way for you to discover gravity is by jumping off a cliff, then that is what you're going to have to experience for yourself.
    Eventually, this "fast and loose" approach of yours will bite you one too many times, then you'll figure out the correct way to do things. - Salem

  4. #4
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    updated

  5. #5
    Registered User kryptkat's Avatar
    Join Date
    Dec 2002
    Posts
    638
    One has to notice that there exist certain cipher that don't need a key at all. A famous example is ROT13 (abbreviation from Rotation 13), a simple Caesar-cipher that obscures text by replacing each letter with the letter thirteen places down in the alphabet. Since our alphabet has 26 characters, it is enough to encrypt the ciphertext again to retrieve the original message.
    umm rot13 has a key.... it is a implied key of 13. Sure it can be done with an algorithm. It is a reciprocal ceazar cipher.

    nice tute

  6. #6
    Frequently Quite Prolix dwks's Avatar
    Join Date
    Apr 2005
    Location
    Canada
    Posts
    8,057
    after the Data Encryption Standard was found too weak because of his small key size
    "its", maybe?

    First,le me show you the keyExpansion function
    "First, let" maybe?

    Execellent tutorial.
    dwk

    Seek and ye shall find. quaere et invenies.

    "Simplicity does not precede complexity, but follows it." -- Alan Perlis
    "Testing can only prove the presence of bugs, not their absence." -- Edsger Dijkstra
    "The only real mistake is the one from which we learn nothing." -- John Powell


    Other boards: DaniWeb, TPS
    Unofficial Wiki FAQ: cpwiki.sf.net

    My website: http://dwks.theprogrammingsite.com/
    Projects: codeform, xuni, atlantis, nort, etc.

  7. #7
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    25th March 2007, 14:37 (GMT+1): fixed and added Key Schedule implementation

  8. #8
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    I would like to let you know that I am still working on this tutorial. I converted it to an HTML version that I hosted on my website. You can find the latest version on http://www.progressive-coding.com/. During the last days, I update some of the features of my website as well, adding a very handy print version of each document and the possibility to download the PDF version (coming soon, couldn't find an html2pdf converter that had full css support).

    I'm giving a basic lecture about algorithm complexity tomorrow and will put the document on my site as well.

  9. #9
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    New update: Today I implemented 2 mode of operations, one that uses only encryption and transforms the block cipher into a streaming cipher and the other a classical block cipher. I'll continue working on the code and put the next chapter in the tutorial up tomorrow.

  10. #10
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    29th March 2007, 13:08 (GMT +1): I uploaded the new version of the tutorial, it includes the new chapter about the entire AES encryption. You should now be able to encrypt a plaintext of 128 bits. I also added the printer friendly version as well as the PDF version:

    Direct Link: http://www.progressive-coding.com/tutorial.php?id=0
    Printer version: http://www.progressive-coding.com/tu...p?id=0&print=1
    PDF version: http://www.progressive-coding.com/pdf/AES.pdf

    I should mention that the tutorial now has 22 pages, I will try to keep the decryption rather short and only mention and implement the 2 most common mode of operations.

  11. #11
    A.I Programmer
    Join Date
    Mar 2007
    Location
    Teresina - Brazil
    Posts
    47
    This Topic must be fixed in the top of the page...

    T+

  12. #12
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    3rd April 2007, 11:41 (GMT +1): New version of the tutorial online. It concludes the AES implementation by adding the decryption section. The next and last part will cover modes of operation to use the AES algorithm to encrypt messages of any size.

    Direct Link: http://www.progressive-coding.com/tutorial.php?id=0
    Printer version: http://www.progressive-coding.com/tu...p?id=0&print=1
    PDF version: http://www.progressive-coding.com/pdf/AES.pdf

    The tutorial has 26 pages now, most of the new pages are C code though, as the decryption is very easy to understand/implement once we have the encryption.

    I expect to finish this tutorial this week (with 3 modes of operation).

  13. #13
    Registered User
    Join Date
    Sep 2006
    Posts
    8,868
    Great tutorial, KONI!!

    Thanks so much.

    Adak

  14. #14
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    I am pleased to announce that my AES tutorial is finished. As I explained on my website, I decided to split the modes of operation tutorial into its very own tutorial. I hope you enjoy reading both tutorials and that you manage to implement your very own version of AES to encrypt messages of any size.
    Here are the links to the modes of operation tutorial:

    Direct Link: http://www.progressive-coding.com/tutorial.php?id=4
    Printer version: http://www.progressive-coding.com/tu...p?id=4&print=1
    PDF version: http://www.progressive-coding.com/pd..._operation.pdf

    I think my next project will be to write a tutorial about the MD5 hash.
    Last edited by KONI; 04-04-2007 at 06:08 AM.

  15. #15
    Lean Mean Coding Machine KONI's Avatar
    Join Date
    Mar 2007
    Location
    Luxembourg, Europe
    Posts
    444
    This thread is currently the 5th result in google for "Advanced Encryption Standard tutorial", which is kinda great. Since I can't edit my first post anymore, I would like to ask a mod to edit my first post and add a header message saying that the latest version of this tutorial can be found here.

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. help needed with edit control & encryption
    By willc0de4food in forum Windows Programming
    Replies: 2
    Last Post: 03-16-2006, 08:21 PM
  2. Abstract Base Class and References
    By Thantos in forum C++ Programming
    Replies: 9
    Last Post: 10-13-2004, 01:35 PM
  3. im extreamly new help
    By rigo305 in forum C++ Programming
    Replies: 27
    Last Post: 04-23-2004, 11:22 PM
  4. include question
    By Wanted420 in forum C++ Programming
    Replies: 8
    Last Post: 10-17-2003, 03:49 AM
  5. What's wrong with my Stream Cipher Encryption?
    By Davros in forum C++ Programming
    Replies: 3
    Last Post: 04-18-2002, 09:51 PM