Difference between revisions of "Building Existing Software Packages with EMAC OE SDK"
(adding conventions table) |
(complex list) |
||
| Line 23: | Line 23: | ||
{{mbox | type = notice | text = The instructions in this section are valid as of the master git branch on 4/09/11. Future source changes may impact the required steps for compilation.}} | {{mbox | type = notice | text = The instructions in this section are valid as of the master git branch on 4/09/11. Future source changes may impact the required steps for compilation.}} | ||
| − | + | <cl> | |
| + | 1. Begin by downloading the mtd-utils source code. Assuming that git is installed on the development system, run the following command to get the most recent version. Note that this version will be different from the stable release installed on EMAC OE systems by default. | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ git clone git://git.infradead.org/mtd-utils.git | developer@ldc:~$ git clone git://git.infradead.org/mtd-utils.git | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | * After downloading the source, navigate to the source directory <code>mtd-utils</code> and open <code>Makefile</code> in the top-level directory. This file defines various make targets and compilation flags used to compile the source. Notice that the file <code>common.mk</code> is sourced with the line include <code>common.mk</code>. This is similar to the <code>global.properties</code> file in the EMAC OE SDK. | |
| − | + | * Close the <code>Makefile</code> editor and open the <code>common.mk</code> file. At the top of the file, <code>CC</code>, <code>AR</code>, and <code>RANLIB</code> are defined using the <code>CROSS</code> variable, which is not set in either <code>common.mk</code> or <code>Makefile</code>. An exert is shown below: | |
<syntaxhighlight lang="make"> | <syntaxhighlight lang="make"> | ||
CC := $(CROSS)gcc | CC := $(CROSS)gcc | ||
| Line 38: | Line 39: | ||
CFLAGS ?= -O2 -g | CFLAGS ?= -O2 -g | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | * Close <code>common.mk</code> without making any changes. | |
| − | + | * In order to compile the source correctly, the <code>CROSS</code> and <code>CFLAGS</code> variables should be defined. The tuning flags for the target architecture to be added to the <code>CFLAGS</code> variable should be used from the <code>ARCHFLAGS</code> variable in the <code>global.properties</code> file of the EMAC OE SDK. The following steps utilize tuning flags for an armv5te processor-based system. Although the path to the SDK toolchain could be included directly in the <code>CROSS</code> variable in this instance, this example works by adding the SDK toolchain to the system <code>PATH</code> variable. The path and prefix used will differ depending on the target architecture of the EMAC OE SDK; refer to <code>global.properties</code> in the SDK to determine the correct settings. The <code>DESTDIR</code> variable controls where the files are put when running the <code>install</code> make target. The <code>WITHOUT_XATTR</code> flag must be set to disable features of the software that are not available on EMAC OE. | |
| − | + | i. Before compiling, several source changes are required to match the setup of the SDK. These include changing references from <code>lzo2</code> to <code>lzo</code>, and changing the lzo include prefix. Run the following commands from the mtd-utils directory to make these changes: | |
| − | <syntaxhighlight lang="bash"> | + | <syntaxhighlight lang="bash"> |
| − | developer@ldc:~$ for file in `find . -name Makefile`; do sed -i 's:lzo2:lzo:g' $file; done | + | developer@ldc:~$ for file in `find . -name Makefile`; do sed -i 's:lzo2:lzo:g' $file; done |
| − | developer@ldc:~$ for file in `find . -name '*.c'`; do sed -i 's:lzo/::g' $file; done | + | developer@ldc:~$ for file in `find . -name '*.c'`; do sed -i 's:lzo/::g' $file; done |
| − | </syntaxhighlight> | + | </syntaxhighlight> |
| − | + | * Run the following commands to set the variables: | |
| − | <syntaxhighlight lang="bash"> | + | <syntaxhighlight lang="bash"> |
| − | developer@ldc:~$ export PATH=$PATH:/path/to/sdk/EMAC-OE-arm-linux-gnueabi-SDK_XX.YY/gcc-4.2.4-arm-linux-gnueabi/bin | + | developer@ldc:~$ export PATH=$PATH:/path/to/sdk/EMAC-OE-arm-linux-gnueabi-SDK_XX.YY/gcc-4.2.4-arm-linux-gnueabi/bin |
| − | developer@ldc:~$ export CROSS=arm-linux-gnueabi- | + | developer@ldc:~$ export CROSS=arm-linux-gnueabi- |
| − | developer@ldc:~$ export CFLAGS="-O2 -g -march=armv5te -mtune=arm926ej-s" | + | developer@ldc:~$ export CFLAGS="-O2 -g -march=armv5te -mtune=arm926ej-s" |
| − | developer@ldc:~$ export DESTDIR=Install | + | developer@ldc:~$ export DESTDIR=Install |
| − | developer@ldc:~$ export WITHOUT_XATTR=1 | + | developer@ldc:~$ export WITHOUT_XATTR=1 |
| − | </syntaxhighlight> | + | </syntaxhighlight> |
| − | + | * Once the environment has been set up, <code>make</code> can be used to compile the source code: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ make all | developer@ldc:~$ make all | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | * After successfully compiling the project, the <code>install</code> make target can be used to package all of the software into the <code>Install</code> directory as specified by the <code>DESTDIR</code> variable: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ make install | developer@ldc:~$ make install | ||
| Line 84: | Line 85: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
While the procedure in this example is specific to <code>mtd-utils</code>, many makefile-based projects will require similar steps for cross-compiling. | While the procedure in this example is specific to <code>mtd-utils</code>, many makefile-based projects will require similar steps for cross-compiling. | ||
| + | </cl> | ||
==Autotools-based Projects== | ==Autotools-based Projects== | ||
| Line 95: | Line 97: | ||
The libConfuse project is a simple C library written for parsing configuration files. It uses an autotools build system for configuration. The steps below demonstrate how to build libConfuse and should be used as an example for building other autotools-based projects. | The libConfuse project is a simple C library written for parsing configuration files. It uses an autotools build system for configuration. The steps below demonstrate how to build libConfuse and should be used as an example for building other autotools-based projects. | ||
| − | + | <cl> | |
| − | + | 1. The source code for the libConfuse project can be downloaded as described on the project website [http://www.nongnu.org/confuse/]. For this example, release 2.7 is used: [http://savannah.nongnu.org/download/confuse/confuse-2.7.tar.gz]. After downloading the source, extract the archive and navigate to the top-level directory of the project (i.e. `confuse-2.7`). | |
| + | * Read through the <code>README</code> and <code>INSTALL</code> files for information on the project and general information on how to build it. Also, look at the help output from <code>configure</code> to see a summary of the available options: | ||
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ ./configure --help | developer@ldc:~$ ./configure --help | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | * Before beginning, the system <code>PATH</code> variable should be changed to include the SDK toolchain as in the makefile-based project example. The <code>CFLAGS</code> variable should also be set. If the <code>CC</code> variable is set, it should be set to <code>arm-linux-gnueabi-gcc</code> (or the appropriate value for the target); if not set the compiler name will be detected from the options passed to configure. The <code>CFLAGS</code> architecture tuning values should be set according to the <code>global.properties</code> file in the EMAC OE SDK. The <code>DESTDIR</code> variable determines where the files will be installed to when the <code>install</code> make target is run. <code>DESTDIR</code> must be an absolute path for the libConfuse project, so the current working directory is added to the variable using the <code>pwd</code> command. The following commands are an example of how to set up the environment correctly: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ export CFLAGS="-O2 -march=armv5te -mtune=arm926ej-s" | developer@ldc:~$ export CFLAGS="-O2 -march=armv5te -mtune=arm926ej-s" | ||
developer@ldc:~$ export DESTDIR=`pwd`/Install | developer@ldc:~$ export DESTDIR=`pwd`/Install | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| − | + | * After setting the environment, <code>configure</code> can be run with the appropriate options to configure the build system and generate the makefiles. The code below shows an example configuration used by EMAC OE. Be sure to set the host and target correctly based on the architecture: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ ./configure --build=i686-linux --host=arm-linux-gnueabi --target=arm-linux-gnueabi \ | developer@ldc:~$ ./configure --build=i686-linux --host=arm-linux-gnueabi --target=arm-linux-gnueabi \ | ||
| Line 114: | Line 117: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
The configuration should complete successfully. If any problems are reported that result in an error, check the environment settings and <code>configure</code> options again. | The configuration should complete successfully. If any problems are reported that result in an error, check the environment settings and <code>configure</code> options again. | ||
| − | + | * Now that <code>configure</code> has generated all of the makefiles for the project, <code>make</code> can be used to compile the source code: | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ make all | developer@ldc:~$ make all | ||
</syntaxhighlight> | </syntaxhighlight> | ||
If any errors are encountered during compilation, examine the output of <code>configure</code> and make sure that all of the environment variables and <code>configure</code> options were specified correctly. | If any errors are encountered during compilation, examine the output of <code>configure</code> and make sure that all of the environment variables and <code>configure</code> options were specified correctly. | ||
| − | + | * Once compilation is complete, the <code>install</code> target can be used to package all of the necessary files together so that they can be transferred to the target board. | |
<syntaxhighlight lang="bash"> | <syntaxhighlight lang="bash"> | ||
developer@ldc:~$ make install | developer@ldc:~$ make install | ||
| Line 159: | Line 162: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
Note that not all of the files installed would be necessary to install on the board, such as the man pages and pkgconfig information. | Note that not all of the files installed would be necessary to install on the board, such as the man pages and pkgconfig information. | ||
| + | </cl> | ||
[[Category:EMAC OE SDK]] | [[Category:EMAC OE SDK]] | ||
Revision as of 13:34, 28 May 2013
| Table 1: Conventions | |
|---|---|
/download/directory/ |
The directory to which the SDK archive will be downloaded. |
/path/to/sdk/ |
The directory to which the SDK will be extracted. |
EMAC-OE-arm-linux-gnueabi-SDK_XX.YY.rZZ.tar.bz2EMAC-OE-arm-linux-gnueabi-SDK_XX.YY
|
XX - the SDK major version YY - the SDK minor version ZZ - the SDK current revision |
| target_program | The program executable created to run on the target device. |
developer@ldc:~$
|
Prompt and commands to be run on a development machine that will run compliation tasks. |
root@emac-oe:~#
|
Prompt and commands to be run on a target machine. |
It is very common to need to be able to build existing software projects for the target hardware rather than developing the software from scratch. This feature is especially important in an open source environment, where countless libraries and utilities are available for use and often times need to be compiled to match the target architecture. Fortunately, EMAC OE SDK toolchains are standard GCC packages designed and configured to make this process as easy as possible. In addition, most software projects are developed to allow for cross-platform development.
This guide provides an overview of the most common tasks associated with compiling existing software projects using the SDK. Note, however, that build methods differ significantly depending on the project design. Refer to the project documentation or support for information on how to cross-compile the software; the EMAC OE SDK can be treated as a standard GCC toolchain in this respect. Table 1 below denotes some conventions used in this guide.
Contents
Makefile-based Projects
Some projects have a build system based on a set of makefiles that are responsible for compiling and packaging the software. In general, configuring these projects to compile using the EMAC OE SDK is a simple process. In some instances, the software designers may have included a variable in the makefile which allows a cross-compiler prefix setting. In other cases, the CC and other makefile variables can be modified to direct make to compile using the EMAC OE SDK.
It may be advantageous to add the cross-compiler bin directory to the system PATH variable temporarily before compiling to simplify Makefile modifications. This can be done with a command such as the following:
developer@ldc:~$ export PATH=$PATH:/path/to/sdk/EMAC-OE-arm-linux-gnueabi-SDK_XX.YY/gcc-4.2.4-arm-linux-gnueabi/bin
| Note that running the command above will only affect the current terminal session. |
MTD Utilities Project Example
The MTD Utilities project mtd-utils is a good example of a Makefile-based build system that can easily be built using the EMAC OE SDK. Follow the steps below to accomplish this task.
| The instructions in this section are valid as of the master git branch on 4/09/11. Future source changes may impact the required steps for compilation. |
-
Begin by downloading the mtd-utils source code. Assuming that git is installed on the development system, run the following command to get the most recent version. Note that this version will be different from the stable release installed on EMAC OE systems by default.
developer@ldc:~$ git clone git://git.infradead.org/mtd-utils.git
-
After downloading the source, navigate to the source directory
mtd-utilsand openMakefilein the top-level directory. This file defines various make targets and compilation flags used to compile the source. Notice that the filecommon.mkis sourced with the line includecommon.mk. This is similar to theglobal.propertiesfile in the EMAC OE SDK. -
Close the
Makefileeditor and open thecommon.mkfile. At the top of the file,CC,AR, andRANLIBare defined using theCROSSvariable, which is not set in eithercommon.mkorMakefile. An exert is shown below:CC := $(CROSS)gcc AR := $(CROSS)ar RANLIB := $(CROSS)ranlib
If the
CROSSvariable is defined whenmakeis run, the specific toolchain to use can be specified. Also note thatCFLAGSis defined using a?=assignment, which means that the assignment will only be made ifCFLAGSis undefined:CFLAGS ?= -O2 -g
-
Close
common.mkwithout making any changes. -
In order to compile the source correctly, the
CROSSandCFLAGSvariables should be defined. The tuning flags for the target architecture to be added to theCFLAGSvariable should be used from theARCHFLAGSvariable in theglobal.propertiesfile of the EMAC OE SDK. The following steps utilize tuning flags for an armv5te processor-based system. Although the path to the SDK toolchain could be included directly in theCROSSvariable in this instance, this example works by adding the SDK toolchain to the systemPATHvariable. The path and prefix used will differ depending on the target architecture of the EMAC OE SDK; refer toglobal.propertiesin the SDK to determine the correct settings. TheDESTDIRvariable controls where the files are put when running theinstallmake target. TheWITHOUT_XATTRflag must be set to disable features of the software that are not available on EMAC OE.-
Before compiling, several source changes are required to match the setup of the SDK. These include changing references from
lzo2tolzo, and changing the lzo include prefix. Run the following commands from the mtd-utils directory to make these changes:developer@ldc:~$ for file in `find . -name Makefile`; do sed -i 's:lzo2:lzo:g' $file; done developer@ldc:~$ for file in `find . -name '*.c'`; do sed -i 's:lzo/::g' $file; done
-
Run the following commands to set the variables:
developer@ldc:~$ export PATH=$PATH:/path/to/sdk/EMAC-OE-arm-linux-gnueabi-SDK_XX.YY/gcc-4.2.4-arm-linux-gnueabi/bin developer@ldc:~$ export CROSS=arm-linux-gnueabi- developer@ldc:~$ export CFLAGS="-O2 -g -march=armv5te -mtune=arm926ej-s" developer@ldc:~$ export DESTDIR=Install developer@ldc:~$ export WITHOUT_XATTR=1
-
-
Once the environment has been set up,
makecan be used to compile the source code:developer@ldc:~$ make all
-
After successfully compiling the project, the
installmake target can be used to package all of the software into theInstalldirectory as specified by theDESTDIRvariable:developer@ldc:~$ make install developer@ldc:~$ ls -R Install
Install: usr Install/usr: sbin share Install/usr/sbin: docfdisk flash_erase flash_lock flash_unlock jffs2dump nanddump nftldump rfddump sumtool doc_loadbios flash_eraseall flash_otp_dump ftl_check mkfs.jffs2 nandtest nftl_format rfdformat flashcp flash_info flash_otp_info ftl_format mtd_debug nandwrite recv_image serve_image Install/usr/share: man Install/usr/share/man: man1 Install/usr/share/man/man1: mkfs.jffs2.1.gz
While the procedure in this example is specific to
mtd-utils, many makefile-based projects will require similar steps for cross-compiling.
Autotools-based Projects
The GNU build system is known as Autotools. Autotools is a group of applications that are designed to provide a configurable build system to allow compilation on different platforms and environments. A configure script and set of input files are used to generate makefiles based on options passed to the configure script and deduced from the system environment. This includes tests for compiler options, library functions, install configuration, and other assorted variables.
The configure script is the most important step in building an autotools-based project. Although available options for configure vary depending on the project design, there are common options shared between most autotools projects.
libConfuse Example Project
The libConfuse project is a simple C library written for parsing configuration files. It uses an autotools build system for configuration. The steps below demonstrate how to build libConfuse and should be used as an example for building other autotools-based projects.
-
The source code for the libConfuse project can be downloaded as described on the project website [1]. For this example, release 2.7 is used: [2]. After downloading the source, extract the archive and navigate to the top-level directory of the project (i.e. `confuse-2.7`).
-
Read through the
READMEandINSTALLfiles for information on the project and general information on how to build it. Also, look at the help output fromconfigureto see a summary of the available options:developer@ldc:~$ ./configure --help
-
Before beginning, the system
PATHvariable should be changed to include the SDK toolchain as in the makefile-based project example. TheCFLAGSvariable should also be set. If theCCvariable is set, it should be set toarm-linux-gnueabi-gcc(or the appropriate value for the target); if not set the compiler name will be detected from the options passed to configure. TheCFLAGSarchitecture tuning values should be set according to theglobal.propertiesfile in the EMAC OE SDK. TheDESTDIRvariable determines where the files will be installed to when theinstallmake target is run.DESTDIRmust be an absolute path for the libConfuse project, so the current working directory is added to the variable using thepwdcommand. The following commands are an example of how to set up the environment correctly:developer@ldc:~$ export CFLAGS="-O2 -march=armv5te -mtune=arm926ej-s" developer@ldc:~$ export DESTDIR=`pwd`/Install
-
After setting the environment,
configurecan be run with the appropriate options to configure the build system and generate the makefiles. The code below shows an example configuration used by EMAC OE. Be sure to set the host and target correctly based on the architecture:developer@ldc:~$ ./configure --build=i686-linux --host=arm-linux-gnueabi --target=arm-linux-gnueabi \ --prefix=/usr --exec_prefix=/usr --bindir=/usr/bin --sbindir=/usr/sbin \ --datadir=/usr/share \ --infodir=/usr/share/info \ --mandir=/usr/share/man --enable-shared
The configuration should complete successfully. If any problems are reported that result in an error, check the environment settings and
configureoptions again. -
Now that
configurehas generated all of the makefiles for the project,makecan be used to compile the source code:developer@ldc:~$ make all
If any errors are encountered during compilation, examine the output of
configureand make sure that all of the environment variables andconfigureoptions were specified correctly. -
Once compilation is complete, the
installtarget can be used to package all of the necessary files together so that they can be transferred to the target board.developer@ldc:~$ make install developer@ldc:~$ ls -R Install
Install: usr Install/usr: include lib share Install/usr/include: confuse.h Install/usr/lib: libconfuse.a libconfuse.la libconfuse.so libconfuse.so.0 libconfuse.so.0.0.0 pkgconfig Install/usr/lib/pkgconfig: libconfuse.pc Install/usr/share: locale Install/usr/share/locale: fr sv Install/usr/share/locale/fr: LC_MESSAGES Install/usr/share/locale/fr/LC_MESSAGES: confuse.mo Install/usr/share/locale/sv: LC_MESSAGES Install/usr/share/locale/sv/LC_MESSAGES: confuse.mo
Note that not all of the files installed would be necessary to install on the board, such as the man pages and pkgconfig information.