Hi, this is likely because your system is running out of memory during compilation. By default, MRtrix3 uses multiple CPU cores to speed up the build process which may result in an out of memory error. To disable multithreaded builds, you can try this:
NUMBER_OF_PROCESSORS=1 ./build
See here for more information.