Build failure for 5.1.0-RC2 on Mac OS 10.8

[Jack Howarth]

On Wed, Dec 12, 2012 at 10:57:22PM +0100, Torbjorn Granlund wrote:
> I pushed a changeset for this problem.
> 
> I have made sure it works on one Mac system and a FreeBSD system.
> Next round of nightly builds will tell us more.
> 
> If the nightly builds goes well, I'll make an RC3 tomorrow.

A current hg pull and update of gmp trunk produces 11 failures on
x86_64-apple-darwin12 against Xcode 4.5.2...

make  check-TESTS
PASS: t-asmtype
PASS: t-aors_1
PASS: t-divrem_1
PASS: t-mod_1
/bin/sh: line 1: 18963 Illegal instruction: 4  ${dir}$tst
FAIL: t-fat
PASS: t-get_d
PASS: t-instrument
PASS: t-iord_u
PASS: t-mp_bases
PASS: t-perfsqr
PASS: t-scan
PASS: logic
PASS: t-toom22
PASS: t-toom32
PASS: t-toom33
PASS: t-toom42
PASS: t-toom43
PASS: t-toom44
PASS: t-toom52
PASS: t-toom53
PASS: t-toom54
PASS: t-toom62
PASS: t-toom63
PASS: t-toom6h
PASS: t-toom8h
/bin/sh: line 1: 19302 Illegal instruction: 4  ${dir}$tst
FAIL: t-toom2-sqr
/bin/sh: line 1: 19320 Illegal instruction: 4  ${dir}$tst
FAIL: t-toom3-sqr
/bin/sh: line 1: 19338 Illegal instruction: 4  ${dir}$tst
FAIL: t-toom4-sqr
/bin/sh: line 1: 19356 Illegal instruction: 4  ${dir}$tst
FAIL: t-toom6-sqr
/bin/sh: line 1: 19374 Illegal instruction: 4  ${dir}$tst
FAIL: t-toom8-sqr
PASS: t-mul
/bin/sh: line 1: 19408 Segmentation fault: 11  ${dir}$tst
FAIL: t-mullo
PASS: t-mulmod_bnm1
/bin/sh: line 1: 19442 Illegal instruction: 4  ${dir}$tst
FAIL: t-sqrmod_bnm1
PASS: t-mulmid
PASS: t-hgcd
PASS: t-hgcd_appr
PASS: t-matrix22
PASS: t-invert
PASS: t-div
/bin/sh: line 1: 19556 Segmentation fault: 11  ${dir}$tst
FAIL: t-bdiv
/bin/sh: line 1: 19574 Illegal instruction: 4  ${dir}$tst
FAIL: t-broot
/bin/sh: line 1: 19592 Bus error: 10           ${dir}$tst
FAIL: t-brootinv
======================================================================================
11 of 43 tests failed
Please report to gmp-bugs at gmplib.org, see http://gmplib.org/manual/Reporting-Bugs.html
======================================================================================

Same result for "./configure ABI=64;make;make check" using either llvm-gcc or clang.

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-fat 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x0000000000000005
0x000000010006a991 in mpn_fft_table3 ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-toom2-sqr 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x00000001050997f0
0x00000001000692e4 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x00000001000692e4 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbfdc38 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-toom3-sqr 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x00000001050997f0
0x00000001000692e4 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x00000001000692e4 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbfcf58 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-toom4-sqr 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_INSTRUCTION, Illegal instruction/operand.
0x00000001000693b9 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x00000001000693b9 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbfbcd8 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-toom6-sqr 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_INSTRUCTION, Illegal instruction/operand.
0x000000010006953b in mpn_fft_table3 ()
(gdb) bt
#0  0x000000010006953b in mpn_fft_table3 ()
#1  0x00007fff5fbfc828 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-toom8-sqr 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x000000010509a7f0
0x000000010006a2e4 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x000000010006a2e4 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbe4878 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-mullo 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0xffffffe0000027ff
0x0000000100059999 in mpn_fft_table3 ()
(gdb) bt
#0  0x0000000100059999 in mpn_fft_table3 ()
#1  0x0000000100034ab2 in __gmpn_mullo_n (rp=0x7fff5fbf5688, xp=0x7fff5fbfd690, yp=0x7fff5fbfb690, n=2) at mullo_n.c:220
#2  0x0000000100001076 in main (argc=<value temporarily unavailable, due to optimizations>, argv=<value temporarily unavailable, due to optimizations>) at ../../../tests/mpn/t-mullo.c:103

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-sqrmod_bnm1 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_INSTRUCTION, Illegal instruction/operand.
0x000000010006a3b9 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x000000010006a3b9 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbf7670 in ?? ()
#2  0x0000000100054ff1 in __gmpn_sqrmod_bnm1 (rp=0x7fff5fbf7670, rn=12, ap=0x7fff5fbf7670, an=9, tp=0x100803c20) at sqrmod_bnm1.c:102
#3  0xffffffffffffffff in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-bdiv 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x0000000000000000
0x000000010005a9b8 in mpn_fft_table3 ()
(gdb) bt
#0  0x000000010005a9b8 in mpn_fft_table3 ()
#1  0x0000000100035ab2 in __gmpn_mullo_n (rp=0x7fff5fbfb628, xp=0x7fff5fbf7608, yp=0x100809c08, n=3) at mullo_n.c:220

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-broot 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: KERN_INVALID_ADDRESS at address: 0x00000001050897f0
0x00000001000592e4 in _gmpn_invert_limb_table ()
(gdb) bt
#0  0x00000001000592e4 in _gmpn_invert_limb_table ()
#1  0x00007fff5fbfa410 in ?? ()

(gdb) r
Starting program: /Users/howarth/gmp/build/tests/mpn/.libs/t-brootinv 
Reading symbols for shared libraries ++............................. done

Program received signal EXC_BAD_ACCESS, Could not access memory.
Reason: 13 at address: 0x0000000000000000
0x000000010005913c in __gmpn_bases ()
(gdb) bt
#0  0x000000010005913c in __gmpn_bases ()
#1  0x0000000000000002 in ?? ()
#2  0x000000010004d657 in __gmpn_powlo (rp=0x7fff5fbfd038, bp=0x7fff5fbfed60, ep=0x7fff5fbfcc48, en=<value temporarily unavailable, due to optimizations>, n=2, tp=0x7fff5fbfed60) at powlo.c:97
#3  0x000000010004ba60 in __gmpn_brootinv (rp=0x7fff5fbfed60, yp=0x7fff5fbff210, bn=2, k=3, tp=0x7fff5fbfcc90) at brootinv.c:125
#4  0x0000000000000003 in ?? ()

I also tried relinking with -Wl,-no_pie just to make sure we weren't seeing some fail-out from ASLR. This had no effect on the segfaults.
               Jack
> 
> -- 
> Torbjörn