cbench-consumer-mad compile error with milepost

[Alan Melo Clappis]

ck compile program:cbench-consumer-mad --compiler_tags=milepost

cbench-consumer-mad (f258a1b1479593a5)

Current directory: /home/clappis/CK/ctuning-programs/program/cbench-consumer-mad/tmp

Resolving software dependencies ...

Dependency 1 = compiler (C compiler):

Resolved. CK environment UID = 9ba414baaedb8ca4 (version 4.4.4)

Dependency 2 = xopenme (xOpenME library):

Resolved. CK environment UID = aa0e190307675c9b (version 0.3)

Detected compiler version: 4.4.4

Compiler vars:
CK_HOST_OS_NAME2_LINUX=1
CK_HOST_OS_NAME_LINUX=1
CK_TARGET_OS_NAME2_LINUX=1
CK_TARGET_OS_NAME_LINUX=1
FPM_DEFAULT=
HAVE_CONFIG_H=
XOPENME=

Executing prepared batch file tmp-uRRbd2.sh ...

gcc -c -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DFPM_DEFAULT -DHAVE_CONFIG_H -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include ../audio.c -o audio.o
gcc -c -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DFPM_DEFAULT -DHAVE_CONFIG_H -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include ../audio_aiff.c -o audio_aiff.o
gcc -c -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DFPM_DEFAULT -DHAVE_CONFIG_H -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include ../audio_cdda.c -o audio_cdda.o
gcc -c -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DFPM_DEFAULT -DHAVE_CONFIG_H -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include ../audio_esd.c -o audio_esd.o
In file included from ../audio_esd.c:26:0:
/usr/include/unistd.h:782:12: error: expected identifier or ‘(’ before ‘int’
extern int isatty (int __fd) __THROW;
^
../global.h:51:26: error: expected ‘)’ before ‘==’ token
define isatty(x) ((x) == STDIN_FILENO)
^

---

Compilation time: 0.130 sec.; Object size: 0; Total binary size: 0; MD5:
Warning: compilation failed!

Maybe is missing some lib in my machine or the milepost is so old for some system libs?

[Grigori Fursin]

By the way, Alan,

Can you please tell us how did you install MILEPOST GCC, i.e. did you use a Docker image or you compiled MILEPOST GCC on your system?

In such case, can you please provide a bit more info about your OS and a platform?

You can also share the output from:

 ck detect platform

Thanks a lot,
Grigori

--
You received this message because you are subscribed to the Google Groups "ctuning-discussions" group.
To unsubscribe from this group and stop receiving emails from it, send an email to ctuning-discuss...@googlegroups.com.
To post to this group, send email to ctuning-d...@googlegroups.com.
Visit this group at https://groups.google.com/group/ctuning-discussions.
For more options, visit https://groups.google.com/d/optout.

[Alan Melo Clappis]

I tried with two machines, both I installed as follow:

$ sudo apt-get update && apt-get install -y python-all git bzip2 sudo wget zip
$ sudo pip install ck
$ sudo apt-get install -y libjpeg8 libjpeg62-dev libfreetype6 libfreetype6-dev python-pillow
$ sudo apt-get install -y build-essential automake autoconf libncurses-dev uuid-runtime m4
$ sudo apt-get install -y gcc g++ g++-multilib libc6-dev-i386
$ sudo apt-get install -y texinfo libisl-dev libcloog-isl-dev libmpc-dev libgmp-dev libmpfr-dev

$ ck pull repo:reproduce-milepost-project
$ ck install package:compiler-gcc-4.4.4-milepost-src-deps
$ ck install package:compiler-ctuning-cc-2.5-plugins-src
$ ck install package:compiler-ctuning-cc-2.5-src

ck detect platafrom machine 1:

OS CK UOA:            linux-64 (4258b5fe54828a50)

OS name:              Debian GNU/Linux 9 (stretch)

Short OS name:        Linux 4.9.0

Long OS name:         Linux-4.9.0-4-amd64-x86_64-with-debian-9.4

OS bits:              64

OS ABI:               x86_64

Platform init UOA:    e5308448618d4bb7

Number of logical processors: 8

CPU name:                     Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz

CPU ABI:                      

CPU features:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf eagerfpu pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm epb tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms xsaveopt dtherm arat pln pts

CPU frequency:

  CPU0 = 1665.136 MHz

  CPU1 = 1612.841 MHz

  CPU2 = 1600.183 MHz

  CPU3 = 1599.975 MHz

  CPU4 = 1707.678 MHz

  CPU5 = 1649.572 MHz

  CPU6 = 1599.975 MHz

  CPU7 = 1600.183 MHz

CPU max frequency:

  CPU0 = 3400.0 MHz

  CPU1 = 3400.0 MHz

  CPU2 = 3400.0 MHz

  CPU3 = 3400.0 MHz

  CPU4 = 3400.0 MHz

  CPU5 = 3400.0 MHz

  CPU6 = 3400.0 MHz

  CPU7 = 3400.0 MHz

***************************************************************************************

Detecting GPU features ...

Executing: lspci > /tmp/tmp-ck-y9HTb3 2> /tmp/tmp-ck-49oKIO

GPU name:   Intel Corporation Xeon E3-1200 v2/3rd Gen Core processor Graphics Controller (rev 09)

GPU vendor: Intel

***************************************************************************************

Detecting system features ...

Platform name:   Gigabyte Technology Co., Ltd. To be filled by O.E.M. (To be filled by O.E.M.)

Platform vendor: Gigabyte Technology Co., Ltd.

Platform model:  To be filled by O.E.M.

ck detect plataform machine 2:

OS CK UOA:            linux-64 (4258b5fe54828a50)

OS name:              Ubuntu 16.04.4 LTS

Short OS name:        Linux 4.15.0

Long OS name:         Linux-4.15.0-39-generic-x86_64-with-Ubuntu-16.04-xenial

OS bits:              64

OS ABI:               x86_64

Platform init UOA:    42818da3a0789331

Number of logical processors: 4

CPU name:                     Intel(R) Core(TM) i7-4500U CPU @ 1.80GHz

CPU ABI:                      

CPU features:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm cpuid_fault epb invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 avx2 smep bmi2 erms invpcid xsaveopt dtherm ida arat pln pts flush_l1d

CPU frequency:

  CPU0 = 1594.226 MHz

  CPU1 = 1619.687 MHz

  CPU2 = 1610.192 MHz

  CPU3 = 1552.091 MHz

CPU max frequency:

  CPU0 = 3000.0 MHz

  CPU1 = 3000.0 MHz

  CPU2 = 3000.0 MHz

  CPU3 = 3000.0 MHz

***************************************************************************************

Detecting GPU features ...

Executing: lspci > /tmp/tmp-ck-W2OcTN 2> /tmp/tmp-ck-sxCMnO

GPU name:   Intel Corporation Haswell-ULT Integrated Graphics Controller (rev 09)

GPU vendor: Intel

***************************************************************************************

Detecting system features ...

Platform name:   Dell Inc. (Vostro 5470)

Platform vendor: Dell Inc.

Platform model:  Vostro 5470

Thanks a lot for your help!

To unsubscribe from this group and stop receiving emails from it, send an email to ctuning-discussions+unsub...@googlegroups.com.

[Alan Melo Clappis]

Using docker returns the same error.

Also, cbench-security-blowfish crashs with milepost compilation

ck compile program:cbench-security-blowfish --compiler_tags=milepost

* cbench-security-blowfish (b2fbb2cfee7a30c7)

***************************************************************************************

Current directory: /home/clappis/CK/ctuning-programs/program/cbench-security-blowfish/tmp

***************************************************************************************

  -----------------------------------

  Resolving software dependencies ...

*** Dependency 1 = compiler (C compiler):

    Resolved. CK environment UID = 9ba414baaedb8ca4 (version 4.4.4)

*** Dependency 2 = xopenme (xOpenME library):

    Resolved. CK environment UID = aa0e190307675c9b (version 0.3)

  -----------------------------------

***************************************************************************************

Detected compiler version: 4.4.4

***************************************************************************************

Compiler vars:

  CK_HOST_OS_NAME2_LINUX=1

  CK_HOST_OS_NAME_LINUX=1

  CK_TARGET_OS_NAME2_LINUX=1

  CK_TARGET_OS_NAME_LINUX=1

  XOPENME=

***************************************************************************************

Executing prepared batch file tmp-u0_5vP.sh ...

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf.c  -o bf.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_cbc.c  -o bf_cbc.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_cfb64.c  -o bf_cfb64.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_ecb.c  -o bf_ecb.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_enc.c  -o bf_enc.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_ofb64.c  -o bf_ofb64.o

gcc -c    -I../ -DCK_HOST_OS_NAME2_LINUX=1 -DCK_HOST_OS_NAME_LINUX=1 -DCK_TARGET_OS_NAME2_LINUX=1 -DCK_TARGET_OS_NAME_LINUX=1 -DXOPENME -I/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/include  ../bf_skey.c  -o bf_skey.o

gcc     bf.o bf_cbc.o bf_cfb64.o bf_ecb.o bf_enc.o bf_ofb64.o bf_skey.o  -o a.out    -L/home/clappis/CK-TOOLS/lib-rtl-xopenme-0.3-gcc-4.4.4-linux-64/lib -lrtlxopenme -lm

***************************************************************************************

Compilation time: 0.215 sec.; Object size: 32504; Total binary size: 30704; MD5: c0e960cbea33cf65baf17793d4fa739b

**************************************************************************************************************************************************************************************

ck run program:cbench-security-blowfish --cmd_key=encode

* cbench-security-blowfish (b2fbb2cfee7a30c7)

OS CK UOA:            linux-64 (4258b5fe54828a50)

OS name:              Ubuntu 16.04.4 LTS

Short OS name:        Linux 4.15.0

Long OS name:         Linux-4.15.0-39-generic-x86_64-with-Ubuntu-16.04-xenial

OS bits:              64

OS ABI:               x86_64

Platform init UOA:    42818da3a0789331

***************************************************************************************

Current directory: /home/clappis/CK/ctuning-programs/program/cbench-security-blowfish/tmp

Reloading depedencies from compilation tmp-deps.json ...

***************************************************************************************

  -----------------------------------

  Resolving software dependencies ...

*** Dependency 1 = compiler (C compiler):

    Resolved. CK environment UID = 9ba414baaedb8ca4 (version 4.4.4)

*** Dependency 2 = xopenme (xOpenME library):

    Resolved. CK environment UID = aa0e190307675c9b (version 0.3)

  -----------------------------------

  -----------------------------------

  Resolving software dependencies ...

  -----------------------------------

  Cleaning output files and directories:

    tmp-output1.tmp

    tmp-output2.tmp

    tmp-ck-timer.json

    tmp-output.tmp

***************************************************************************************

### Calibration 1 out of 10 ; Kernel repeat number = 1

***************************************************************************************

***************************************************************************************

Prepared script:

#! /bin/bash

export PATH=/home/clappis/CK/ck-env/platform.init/generic-linux:$PATH

. /home/clappis/CK/local/env/9ba414baaedb8ca4/env.sh

. /home/clappis/CK/local/env/aa0e190307675c9b/env.sh

. /home/clappis/CK/local/env/9ba414baaedb8ca4/env.sh 1

export CK_DATASET_PATH=/home/clappis/CK/ctuning-datasets-min/dataset/enc-0001/

export CK_DATASET_FILENAME=data.enc

export CT_REPEAT_MAIN=1

echo    executing code ...

 ./a.out e /home/clappis/CK/ctuning-datasets-min/dataset/enc-0001/data.enc tmp-output.tmp 1234567890abcdeffedcba0987654321 > tmp-output1.tmp 2> tmp-output2.tmp

***************************************************************************************

  (bash -c "chmod 755 ./tmp-oyg1C4.sh; . ./tmp-oyg1C4.sh")

  (sleep 0.5 sec ...)

  (run ...)

executing code ...

./tmp-oyg1C4.sh: linha 19: 22352 Falha de segmentação  (imagem do núcleo gravada) ./a.out e /home/clappis/CK/ctuning-datasets-min/dataset/enc-0001/data.enc tmp-output.tmp 1234567890abcdeffedcba0987654321 > tmp-output1.tmp 2> tmp-output2.tmp

  (reading fine grain timers from tmp-ck-timer.json ...)

Program execution likely failed (can't find fine grain timers)!

[Grigori Fursin]

Hi Alan,

I think this compiler is becoming very outdated. I think the last time I managed to extract features from all cTuning programs was about 6 years ago, so probably it was even Ubuntu 14.04 or 12.04.

However, notice that I recorded all features to the CK ctuning-programs repository at that time so you can use them directly rather than trying to extract them. For example, see features for "cbench-consumer-mad" here: https://github.com/ctuning/ctuning-programs/blob/master/program.static.features/cbench-consumer-mad/.cm/meta.json

You can see all other feature as follows:

 $ ck ls program.static.features

We also do not run programs built with this compiler - we just use features and then combine them with the latest compiler. That's what we did in this report with Raspberry Pi foundation: http://cKnowledge.org/rpi-crowd-tuning , where we compiled programs with gcc 4.9.2 and 7.1.0, and used above features to build models using nearest neighbour classifier, SVM and a few TensorFlow based DNNs.

I suggest you to do the same until one day someone will add a universal feature extractor to the latest GCC or LLVM, and will connect it with the CK workflows...

Hope it's of any help and have a good weekend,
Grigori

To unsubscribe from this group and stop receiving emails from it, send an email to ctuning-discuss...@googlegroups.com.