Go to file
Zhang Xianyi 77460ac255 Fix gemm_batch bug for SMALL_MATRIX_OPT=1. 2020-12-14 09:50:47 +08:00
.github/workflows Test flang build 2020-06-09 06:31:17 +00:00
benchmark Use the fortran compiler to link LAPACK-related benchmarks 2020-05-29 13:35:51 +02:00
cmake Add OpenMP dependency to pkgconfig file if needed 2020-08-22 13:53:44 +02:00
cpp_thread_test revert 2020-08-17 15:20:41 +02:00
ctest cmake fixes 2020-04-17 13:35:17 -05:00
driver Fix gemm_batch bug for SMALL_MATRIX_OPT=1. 2020-12-14 09:50:47 +08:00
exports Init cblas_?gemm_batch implementation. 2020-12-14 09:50:32 +08:00
interface Init cblas_?gemm_batch implementation. 2020-12-14 09:50:32 +08:00
kernel Refs #2587 fix small matrix c/zgemm bug. 2020-08-28 22:36:36 +08:00
lapack Use _Atomic instead of volatile where available (file moved from ../getrf) 2020-07-25 08:52:24 +02:00
lapack-netlib Merge pull request #2764 from martin-frbg/lapacktests 2020-08-10 13:27:51 +02:00
reference Revert reference/ fixes 2019-05-04 15:01:29 -04:00
relapack Merge pull request #2099 from martin-frbg/rela-gbtrf 2019-04-29 09:25:19 +02:00
test Update BLAS tests to correspond to Reference-LAPACK 3.9.0 2020-06-14 10:26:25 +02:00
utest Fix utest build on AIX 2020-06-25 12:58:13 +02:00
.drone.yml revert 2020-08-17 15:19:40 +02:00
.gitignore Add test for shgemm 2020-04-29 13:40:34 -05:00
.travis.yml Add a dedicated POWER9 build to the Travis CI (#2774) 2020-08-12 23:08:38 +02:00
BACKERS.md Added backers. 2013-09-05 15:39:45 +08:00
CMakeLists.txt Do not require pkg-config to generate the *.pc file 2020-08-18 08:48:48 +02:00
CONTRIBUTORS.md update CONTRIBUTORS.md, adding myself 2020-05-20 22:35:26 +08:00
Changelog.txt Update with 0.3.10 changes 2020-06-14 21:55:31 +02:00
GotoBLAS_00License.txt rename documents in GotoBLAS. 2011-01-24 15:57:23 +00:00
GotoBLAS_01Readme.txt Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
GotoBLAS_02QuickInstall.txt Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
GotoBLAS_03FAQ.txt Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
GotoBLAS_04FAQ.txt rename documents in GotoBLAS. 2011-01-24 15:57:23 +00:00
GotoBLAS_05LargePage.txt Correct typo /proc/ instead of /pros/ 2015-03-20 23:25:11 +01:00
GotoBLAS_06WeirdPerformance.txt Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
Jenkinsfile Create Jenkinsfile for OSUOSL PowerCI 2020-08-08 18:05:20 +02:00
LICENSE Update organization info. 2014-11-25 15:28:58 +08:00
Makefile Fix mishandling of NO_CBLAS=0 and NO_LAPACKE=0 2020-08-11 13:40:40 +02:00
Makefile.alpha Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
Makefile.arm Restore -march flag for Android builds 2020-02-16 17:32:13 +01:00
Makefile.arm64 ARM64: Add THUNDERX3T110 Target 2020-07-26 23:32:24 -07:00
Makefile.generic Respect user's LDFLAGS 2013-07-25 14:08:37 -07:00
Makefile.ia64 Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
Makefile.install Add OpenMP dependency to pkgconfig file if needed 2020-08-22 13:55:18 +02:00
Makefile.mips MIPS P5600(32 bit) and I6400(64 bit) cores support added. 2016-04-22 14:03:18 +05:30
Makefile.mips64 Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
Makefile.power Separate OpenMP handling and allow compilation of Power9 code with older gcc 2020-07-30 01:14:08 +02:00
Makefile.prebuild Add compiler options for MIPS32 24K/1004K 2020-04-19 06:50:51 +02:00
Makefile.rule Increment version to 0.3.10.dev 2020-06-14 22:05:19 +02:00
Makefile.sparc Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
Makefile.system Merge branch 'develop' into small_matrices 2020-08-28 21:38:58 +08:00
Makefile.tail RFC : Add half precision gemm for bfloat16 in OpenBLAS 2020-04-14 14:55:08 -05:00
Makefile.x86 Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
Makefile.x86_64 make march=cooperlake option conditional on gcc >= 10.1 2020-08-19 15:06:30 +02:00
Makefile.zarch s390x: Add vectorized sgemm kernel for Z14 and newer 2020-05-12 15:59:51 +02:00
README.md Put hint to use git develop rather than master branch in README 2020-07-28 14:22:41 +00:00
TargetList.txt Enable COOPERLAKE build target 2020-08-13 06:18:00 +08:00
USAGE.md Underline importance of NUM_THREADS setting for BUFFER allocation 2018-04-04 22:26:51 +02:00
appveyor.yml Revert "Add Windows build job on Azure CI (#2566)" 2020-04-19 19:00:37 +02:00
azure-pipelines.yml Update azure-pipelines.yml 2020-06-04 19:03:46 +02:00
c_check Add a check for C11 atomics and stdatomic.h 2020-07-18 16:57:41 +00:00
cblas.h Init cblas_?gemm_batch implementation. 2020-12-14 09:50:32 +08:00
common.h Update conditional for C11 atomics to use HAVE_C11 2020-07-18 17:13:24 +00:00
common_alpha.h Add read barrier definition 2020-04-13 12:09:24 +02:00
common_arm.h ARMV7 does not support DMB ISHLD, use DMB ISH 2020-04-13 15:56:31 +02:00
common_arm64.h Add read barrier definition 2020-04-13 12:11:58 +02:00
common_c.h Refs #2587 Add small matrix optimization reference kernel for c/zgemm. 2020-08-28 21:00:54 +08:00
common_d.h Change a1b0 gemm to b0 gemm. 2020-08-28 07:55:27 +08:00
common_ia64.h Add (empty) read barrier definition 2020-04-13 12:12:54 +02:00
common_interface.h Fix warnings in clang and export symbol 2020-04-15 19:15:23 -05:00
common_lapack.h add missing defines and headers 2019-09-08 11:14:49 -04:00
common_level1.h Add declarations for ?sum and cblas_?sum 2019-03-30 21:58:03 +01:00
common_level2.h Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
common_level3.h Init cblas_?gemm_batch implementation. 2020-12-14 09:50:32 +08:00
common_linux.h Init IBM z system (s390x) porting. 2016-04-15 18:02:24 -04:00
common_macro.h Init cblas_?gemm_batch implementation. 2020-12-14 09:50:32 +08:00
common_mips.h Increase default BUFFER_SIZE to accomodate SGEMM parameters 2020-04-26 22:21:05 +02:00
common_mips64.h Increase BUFFER_SIZE on mips64 to match SGEMM parameters 2020-04-28 10:40:40 +02:00
common_param.h [WIP] Refactor the driver code for direct SGEMM (#2782) 2020-08-19 14:51:09 +02:00
common_power.h Add memory barrier to the blas_lock implementation for Linux 2020-08-09 19:17:04 +02:00
common_q.h Add declarations for ?sum 2019-03-31 22:12:23 +02:00
common_reference.h Update organization info. 2014-11-25 15:28:58 +08:00
common_s.h Merge branch 'develop' into small_matrices 2020-08-28 21:38:58 +08:00
common_sh.h Fix warnings in clang and export symbol 2020-04-15 19:15:23 -05:00
common_sparc.h Add (empty) read barrier definition 2020-04-13 12:17:41 +02:00
common_stackalloc.h Misc. typo fixes 2019-04-29 17:03:56 -04:00
common_thread.h fixes #2238 2020-07-07 13:35:43 +03:00
common_x.h Add declarations for ?sum 2019-03-31 22:12:23 +02:00
common_x86.h Add (empty) read barrier definition 2020-04-13 12:18:48 +02:00
common_x86_64.h Unify BUFFER_SIZE settings for x86_64 again to fix potentially fatal mismatch in DYNAMIC_ARCH builds 2020-07-22 17:30:55 +00:00
common_z.h Refs #2587 Add small matrix optimization reference kernel for c/zgemm. 2020-08-28 21:00:54 +08:00
common_zarch.h Add (empty) read barrier definition 2020-04-13 12:24:10 +02:00
cpuid.S Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
cpuid.h Enable COOPERLAKE build target 2020-08-13 06:18:00 +08:00
cpuid_alpha.c Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
cpuid_arm.c Update cpuid_arm.c 2018-12-28 14:33:18 +01:00
cpuid_arm64.c ARM64: Add THUNDERX3T110 Target 2020-07-26 23:32:24 -07:00
cpuid_ia64.c Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
cpuid_mips.c rename 1004K, 24K to MIPS1004K, MIPS24K to avoid identifier naming problem 2020-04-18 23:50:23 +02:00
cpuid_mips64.c Update cpuid_mips64.c 2018-12-28 14:36:39 +01:00
cpuid_power.c Fix compile error on AIX cpuid detection 2020-08-27 23:10:45 -05:00
cpuid_sparc.c Fix my copypaste blunder with get_corename 2018-02-01 22:06:04 +01:00
cpuid_x86.c Enable COOPERLAKE build target 2020-08-13 06:18:00 +08:00
cpuid_zarch.c Add the cpuid of the business/rackmount version of z15 as well 2019-11-21 18:14:29 +01:00
ctest.c Report availability of C11 support 2020-07-18 16:59:33 +00:00
ctest1.c Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
ctest2.c Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
f_check Patch for building on Summit 2020-07-20 23:30:28 -04:00
ftest.f Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
ftest2.f Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
ftest3.f Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
gen_config_h.c Add 64bit support for Microsoft Visual Studio 2017-06-21 13:38:22 -07:00
getarch.c Enable COOPERLAKE build target 2020-08-13 06:18:00 +08:00
getarch_2nd.c RFC : Add half precision gemm for bfloat16 in OpenBLAS 2020-04-14 14:55:08 -05:00
l1param.h Added BULLDOZER target. So far it uses barcelona kernels. 2012-12-07 00:53:31 +08:00
l2param.h Support AMD Piledriver by bulldozer kernels. 2013-07-06 12:06:43 -03:00
make.inc (Plain make) build system fixes for AIX 2017-09-18 01:29:21 +02:00
openblas.pc.in Rename blas.pc.in to openblas.pc.in 2017-02-12 14:34:03 +01:00
openblas_config_template.h Add typedef for bfloat16 if needed 2020-08-17 15:32:14 +02:00
param.h Enable COOPERLAKE build target 2020-08-13 06:18:00 +08:00
quickbuild.32bit Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
quickbuild.64bit Import GotoBLAS2 1.13 BSD version codes. 2011-01-24 14:54:24 +00:00
quickbuild.win32 Added the tip for Windows. 2012-08-09 20:37:55 +08:00
quickbuild.win64 Refs #63. delete prefix for mingw64 toolchain. 2014-04-27 13:05:26 +08:00
segfaults.patch Remove all trailing whitespace except lapack-netlib 2014-06-27 12:05:18 -07:00
symcopy.h Changed a number of inline calls to use __inline. 2015-02-11 11:13:17 -06:00
version.h Update organization info. 2014-11-25 15:28:58 +08:00

README.md

OpenBLAS

Join the chat at https://gitter.im/xianyi/OpenBLAS

Travis CI: Build Status

AppVeyor: Build status

Drone CI: Build Status

Build Status

Introduction

OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 BSD version.

Please read the documentation on the OpenBLAS wiki pages: https://github.com/xianyi/OpenBLAS/wiki.

Binary Packages

We provide official binary packages for the following platform:

  • Windows x86/x86_64

You can download them from file hosting on sourceforge.net.

Installation from Source

Download from project homepage, https://xianyi.github.com/OpenBLAS/, or check out the code using Git from https://github.com/xianyi/OpenBLAS.git. (If you want the most up to date version, be sure to use the develop branch - master is several years out of date due to a change of maintainership.) Buildtime parameters can be chosen in Makefile.rule, see there for a short description of each option. Most can also be given directly on the make or cmake command line.

Dependencies

Building OpenBLAS requires the following to be installed:

  • GNU Make
  • A C compiler, e.g. GCC or Clang
  • A Fortran compiler (optional, for LAPACK)
  • IBM MASS (optional, see below)

Normal compile

Simply invoking make (or gmake on BSD) will detect the CPU automatically. To set a specific target CPU, use make TARGET=xxx, e.g. make TARGET=NEHALEM. The full target list is in the file TargetList.txt.

Cross compile

Set CC and FC to point to the cross toolchains, and set HOSTCC to your host C compiler. The target must be specified explicitly when cross compiling.

Examples:

  • On an x86 box, compile this library for a loongson3a CPU:

    make BINARY=64 CC=mips64el-unknown-linux-gnu-gcc FC=mips64el-unknown-linux-gnu-gfortran HOSTCC=gcc TARGET=LOONGSON3A
    

    or same with the newer mips-crosscompiler put out by Loongson that defaults to the 32bit ABI:

    make HOSTCC=gcc CC='/opt/mips-loongson-gcc7.3-linux-gnu/2019.06-29/bin/mips-linux-gnu-gcc -mabi=64' FC='/opt/mips-loongson-gcc7.3-linux-gnu/2019.06-29/bin/mips-linux-gnu-gfortran -mabi=64' TARGET=LOONGSON3A
    
  • On an x86 box, compile this library for a loongson3a CPU with loongcc (based on Open64) compiler:

    make CC=loongcc FC=loongf95 HOSTCC=gcc TARGET=LOONGSON3A CROSS=1 CROSS_SUFFIX=mips64el-st-linux-gnu-   NO_LAPACKE=1 NO_SHARED=1 BINARY=32
    

Debug version

A debug version can be built using make DEBUG=1.

Compile with MASS support on Power CPU (optional)

The IBM MASS library consists of a set of mathematical functions for C, C++, and Fortran applications that are tuned for optimum performance on POWER architectures. OpenBLAS with MASS requires a 64-bit, little-endian OS on POWER. The library can be installed as shown:

  • On Ubuntu:

    wget -q http://public.dhe.ibm.com/software/server/POWER/Linux/xl-compiler/eval/ppc64le/ubuntu/public.gpg -O- | sudo apt-key add -
    echo "deb http://public.dhe.ibm.com/software/server/POWER/Linux/xl-compiler/eval/ppc64le/ubuntu/ trusty main" | sudo tee /etc/apt/sources.list.d/ibm-xl-compiler-eval.list
    sudo apt-get update
    sudo apt-get install libxlmass-devel.8.1.5
    
  • On RHEL/CentOS:

    wget http://public.dhe.ibm.com/software/server/POWER/Linux/xl-compiler/eval/ppc64le/rhel7/repodata/repomd.xml.key
    sudo rpm --import repomd.xml.key
    wget http://public.dhe.ibm.com/software/server/POWER/Linux/xl-compiler/eval/ppc64le/rhel7/ibm-xl-compiler-eval.repo
    sudo cp ibm-xl-compiler-eval.repo /etc/yum.repos.d/
    sudo yum install libxlmass-devel.8.1.5
    

After installing the MASS library, compile OpenBLAS with USE_MASS=1. For example, to compile on Power8 with MASS support: make USE_MASS=1 TARGET=POWER8.

Install to a specific directory (optional)

Use PREFIX= when invoking make, for example

make install PREFIX=your_installation_directory

The default installation directory is /opt/OpenBLAS.

Supported CPUs and Operating Systems

Please read GotoBLAS_01Readme.txt for older CPU models already supported by the 2010 GotoBLAS.

Additional supported CPUs

x86/x86-64

  • Intel Xeon 56xx (Westmere): Used GotoBLAS2 Nehalem codes.
  • Intel Sandy Bridge: Optimized Level-3 and Level-2 BLAS with AVX on x86-64.
  • Intel Haswell: Optimized Level-3 and Level-2 BLAS with AVX2 and FMA on x86-64.
  • Intel Skylake-X: Optimized Level-3 and Level-2 BLAS with AVX512 and FMA on x86-64.
  • AMD Bobcat: Used GotoBLAS2 Barcelona codes.
  • AMD Bulldozer: x86-64 ?GEMM FMA4 kernels. (Thanks to Werner Saar)
  • AMD PILEDRIVER: Uses Bulldozer codes with some optimizations.
  • AMD STEAMROLLER: Uses Bulldozer codes with some optimizations.
  • AMD ZEN: Uses Haswell codes with some optimizations.

MIPS32

  • MIPS 1004K: uses P5600 codes
  • MIPS 24K: uses P5600 codes

MIPS64

  • ICT Loongson 3A: Optimized Level-3 BLAS and the part of Level-1,2.
  • ICT Loongson 3B: Experimental

ARM

  • ARMv6: Optimized BLAS for vfpv2 and vfpv3-d16 (e.g. BCM2835, Cortex M0+)
  • ARMv7: Optimized BLAS for vfpv3-d32 (e.g. Cortex A8, A9 and A15)

ARM64

  • ARMv8: Basic ARMV8 with small caches, optimized Level-3 and Level-2 BLAS
  • Cortex-A53: same as ARMV8 (different cpu specifications)
  • Cortex A57: Optimized Level-3 and Level-2 functions
  • Cortex A72: same as A57 ( different cpu specifications)
  • Cortex A73: same as A57 (different cpu specifications)
  • Falkor: same as A57 (different cpu specifications)
  • ThunderX: Optimized some Level-1 functions
  • ThunderX2T99: Optimized Level-3 BLAS and parts of Levels 1 and 2
  • TSV110: Optimized some Level-3 helper functions
  • EMAG 8180: preliminary support based on A57

PPC/PPC64

  • POWER8: Optimized BLAS, only for PPC64LE (Little Endian), only with USE_OPENMP=1
  • POWER9: Optimized Level-3 BLAS (real) and some Level-1,2. PPC64LE with OpenMP only.

IBM zEnterprise System

  • Z13: Optimized Level-3 BLAS and Level-1,2
  • Z14: Optimized Level-3 BLAS and (single precision) Level-1,2

Support for multiple targets in a single library

OpenBLAS can be built for multiple targets with runtime detection of the target cpu by specifiying DYNAMIC_ARCH=1 in Makefile.rule, on the gmake command line or as -DDYNAMIC_ARCH=TRUE in cmake.

For x86_64, the list of targets this activates contains Prescott, Core2, Nehalem, Barcelona, Sandybridge, Bulldozer, Piledriver, Steamroller, Excavator, Haswell, Zen, SkylakeX. For cpu generations not included in this list, the corresponding older model is used. If you also specify DYNAMIC_OLDER=1, specific support for Penryn, Dunnington, Opteron, Opteron/SSE3, Bobcat, Atom and Nano is added. Finally there is an option DYNAMIC_LIST that allows to specify an individual list of targets to include instead of the default.

DYNAMIC_ARCH is also supported on x86, where it translates to Katmai, Coppermine, Northwood, Prescott, Banias, Core2, Penryn, Dunnington, Nehalem, Athlon, Opteron, Opteron_SSE3, Barcelona, Bobcat, Atom and Nano.

On ARMV8, it enables support for CortexA53, CortexA57, CortexA72, CortexA73, Falkor, ThunderX, ThunderX2T99, TSV110 as well as generic ARMV8 cpus.

For POWER, the list encompasses POWER6, POWER8 and POWER9, on ZARCH it comprises Z13 and Z14.

The TARGET option can be used in conjunction with DYNAMIC_ARCH=1 to specify which cpu model should be assumed for all the common code in the library, usually you will want to set this to the oldest model you expect to encounter. Please note that it is not possible to combine support for different architectures, so no combined 32 and 64 bit or x86_64 and arm64 in the same library.

Supported OS

  • GNU/Linux
  • MinGW or Visual Studio (CMake)/Windows: Please read https://github.com/xianyi/OpenBLAS/wiki/How-to-use-OpenBLAS-in-Microsoft-Visual-Studio.
  • Darwin/macOS/OSX/iOS: Experimental. Although GotoBLAS2 already supports Darwin, we are not OSX/iOS experts.
  • FreeBSD: Supported by the community. We don't actively test the library on this OS.
  • OpenBSD: Supported by the community. We don't actively test the library on this OS.
  • NetBSD: Supported by the community. We don't actively test the library on this OS.
  • DragonFly BSD: Supported by the community. We don't actively test the library on this OS.
  • Android: Supported by the community. Please read https://github.com/xianyi/OpenBLAS/wiki/How-to-build-OpenBLAS-for-Android.
  • AIX: Supported on PPC up to POWER8
  • Haiku: Supported by the community. We don't actively test the library on this OS.
  • SunOS: Supported by the community. We don't actively test the library on this OS:

Usage

Statically link with libopenblas.a or dynamically link with -lopenblas if OpenBLAS was compiled as a shared library.

Setting the number of threads using environment variables

Environment variables are used to specify a maximum number of threads. For example,

export OPENBLAS_NUM_THREADS=4
export GOTO_NUM_THREADS=4
export OMP_NUM_THREADS=4

The priorities are OPENBLAS_NUM_THREADS > GOTO_NUM_THREADS > OMP_NUM_THREADS.

If you compile this library with USE_OPENMP=1, you should set the OMP_NUM_THREADS environment variable; OpenBLAS ignores OPENBLAS_NUM_THREADS and GOTO_NUM_THREADS when compiled with USE_OPENMP=1.

Setting the number of threads at runtime

We provide the following functions to control the number of threads at runtime:

void goto_set_num_threads(int num_threads);
void openblas_set_num_threads(int num_threads);

If you compile this library with USE_OPENMP=1, you should use the above functions too.

Reporting bugs

Please submit an issue in https://github.com/xianyi/OpenBLAS/issues.

Contact

Change log

Please see Changelog.txt to view the differences between OpenBLAS and GotoBLAS2 1.13 BSD version.

Troubleshooting

  • Please read the FAQ first.
  • Please use GCC version 4.6 and above to compile Sandy Bridge AVX kernels on Linux/MinGW/BSD.
  • Please use Clang version 3.1 and above to compile the library on Sandy Bridge microarchitecture. Clang 3.0 will generate the wrong AVX binary code.
  • Please use GCC version 6 or LLVM version 6 and above to compile Skylake AVX512 kernels.
  • The number of CPUs/cores should be less than or equal to 256. On Linux x86_64 (amd64), there is experimental support for up to 1024 CPUs/cores and 128 numa nodes if you build the library with BIGNUMA=1.
  • OpenBLAS does not set processor affinity by default. On Linux, you can enable processor affinity by commenting out the line NO_AFFINITY=1 in Makefile.rule. However, note that this may cause a conflict with R parallel.
  • On Loongson 3A, make test may fail with a pthread_create error (EAGAIN). However, it will be okay when you run the same test case on the shell.

Contributing

  1. Check for open issues or open a fresh issue to start a discussion around a feature idea or a bug.
  2. Fork the OpenBLAS repository to start making your changes.
  3. Write a test which shows that the bug was fixed or that the feature works as expected.
  4. Send a pull request. Make sure to add yourself to CONTRIBUTORS.md.

Donation

Please read this wiki page.