floraachy/OpenBLAS
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
8,662 Commits 47 Branches 64 Tags
e05d98d00a8a4cf3566013f12b6420344d579d2e
Commit Graph

797 Commits

Author SHA1 Message Date
Martin Kroeker
28e96458e5 Replace vpermpd with vpermilpd 
to improve performance on Zen/Zen2 (as demonstrated by wjc404 in #2180)
 2019-07-22 08:28:16 +02:00
wjc404
95fb98f556 Update dgemm_kernel_4x8_haswell.S 2019-07-21 01:10:32 +08:00
wjc404
4801c6d36b Update dgemm_kernel_4x8_haswell.S 2019-07-21 00:47:45 +08:00
wjc404
9440fa607d Add files via upload 2019-07-20 22:08:22 +08:00
wjc404
94db259e5b Add files via upload 2019-07-20 22:04:41 +08:00
wjc404
f49f8047ac Add files via upload 2019-07-20 14:33:37 +08:00
wjc404
825777faab Update dgemm_kernel_4x8_haswell.S 2019-07-19 23:58:24 +08:00
wjc404
9c89757562 Add files via upload 2019-07-19 23:47:58 +08:00
wjc404
9b04baeaee Update dgemm_kernel_4x8_haswell.S 2019-07-17 23:50:03 +08:00
wjc404
8a074b3965 Update dgemm_kernel_4x8_haswell.S 2019-07-17 23:47:30 +08:00
wjc404
211ab03b14 Update dgemm_kernel_4x8_haswell.S 2019-07-17 22:39:15 +08:00
wjc404
1733f927e6 Update dgemm_kernel_4x8_haswell.S 2019-07-17 21:27:41 +08:00
wjc404
182b06d6ad Update dgemm_kernel_4x8_haswell.S 2019-07-17 17:02:35 +08:00
wjc404
7a9050d681 Update dgemm_kernel_4x8_haswell.S 2019-07-17 00:55:06 +08:00
wjc404
0ba29fd262 Update dgemm_kernel_4x8_haswell.S for zen2 
replaced a bunch of vpermpd instructions with vpermilpd and vperm2f128
 2019-07-17 00:46:51 +08:00
Martin Kroeker
9ea30f3788 Replace ISMIN and ISAMIN kernels on all x86_64 platforms (#2125) 
* Mark iamax_sse.S as unsuitable for MIN due to issue #2116
* Use iamax.S rather than iamax_sse.S for ISMIN/ISAMIN on all x86_64 as workaround for #2116
 2019-05-09 14:42:36 +02:00
Martin Kroeker
b1561ecc68 Disable DGEMMINCOPY as well for now 
#1955
 2019-05-05 15:52:01 +02:00
Martin Kroeker
7ed8431527 Disable the SkyLakeX DGEMMITCOPY kernel as well 
as a stopgap measure for https://github.com/numpy/numpy/issues/13401 as mentioned in #1955
 2019-05-04 22:54:41 +02:00
Martin Kroeker
c04a729081 Add ?sum definitions for generic kernel 2019-03-31 13:55:49 +02:00
Martin Kroeker
9d717cb5ee Add x86_64 implementation of ?sum 
as trivial copy of ?asum with the fabs calls removed
 2019-03-30 22:27:04 +01:00
Martin Kroeker
32c7063cb0 Merge pull request #2061 from martin-frbg/martin-frbg-patch-1 
Disable the AVX512 DGEMM kernel (again)
 2019-03-30 21:21:38 +01:00
Martin Kroeker
e608d4f7fe Disable the AVX512 DGEMM kernel (again) 
Due to as yet unresolved errors seen in #1955 and #2029
 2019-03-13 22:10:28 +01:00
Celelibi
b7f59da42d Fix crash in sgemm SSE/nano kernel on x86_64 
Fix bug #2047.

Signed-off-by: Celelibi <celelibi@gmail.com>
 2019-03-07 16:55:13 +01:00
Andrew
6eee1beac5 move fix to right place 2019-02-24 20:41:02 +02:00
Martin Kroeker
e12cdf58ef Merge pull request #2024 from martin-frbg/gcc9fixes4 
Fix inline assembly constraints in Bulldozer TRSM kernels
 2019-02-17 11:49:15 +01:00
Martin Kroeker
1860c9456d Merge pull request #2023 from martin-frbg/gcc9fixes3 
Fix inline assembly constraints in various x86_64 GEMVN kernels
 2019-02-17 11:48:57 +01:00
Martin Kroeker
f9bb76d29a Fix inline assembly constraints in Bulldozer TRSM kernels 
rework indices to allow marking i,as and bs as both input and output (marked operand n1 as well for simplicity). For #2009
 2019-02-16 20:06:48 +01:00
Martin Kroeker
efb9038f72 Fix inline assembly constraints 2019-02-16 18:46:17 +01:00
Martin Kroeker
e976557d29 Fix inline assembly constraints 
rework indices to allow marking argument lda as input and output.
 2019-02-16 18:36:39 +01:00
Martin Kroeker
9d8be15789 Fix inline assembly constraints 
rework indices to allow marking argument lda4 as input and output. For #2009
 2019-02-16 18:24:11 +01:00
Martin Kroeker
d752799a0f Merge pull request #2021 from martin-frbg/gcc9fixes2 
Fix wrong constraints in inline assembly of Haswell DTRSM kernel
 2019-02-16 18:05:40 +01:00
Martin Kroeker
c26c0b77a7 Fix wrong constraints in inline assembly 
for #2009
 2019-02-15 15:08:16 +01:00
Martin Kroeker
1c6da2d03c Merge pull request #2019 from martin-frbg/gcc9fixes 
Fix unannounced modification of input operand 8 (lda4) in Haswell GEMVN microkernel
 2019-02-15 15:02:54 +01:00
Martin Kroeker
4255a58cd2 Rename operands to put lda on the input/output constraint list 2019-02-15 10:10:04 +01:00
Martin Kroeker
46e415b140 Save and restore input argument 8 (lda4) 
Fixes miscompilation with gcc9 -ftree-vectorize (related to issue #2009)
 2019-02-14 22:43:18 +01:00
Bart Oldeman
69a97ca7b9 dgemv_kernel_4x4(Haswell): add missing clobbers for xmm0,xmm1,xmm2,xmm3 
This fixes a crash in dblat2 when OpenBLAS is compiled using
-march=znver1 -ftree-vectorize -O2

See also:
https://github.com/easybuilders/easybuild-easyconfigs/issues/7180
 2019-02-14 16:27:58 +00:00
Martin Kroeker
ab1630f9fa Fix declaration of arguments in inline assembly 
Argument 0 is modified so should be input and output
 2019-02-12 16:14:02 +01:00
Martin Kroeker
b824fa70eb Fix declaration of assembly arguments in SSYMV and DSYMV microkernels 
Arguments 0 and 1 are both input and output
 2019-02-12 16:00:18 +01:00
Martin Kroeker
91481a3e4e Fix declaration of input arguments in inline assembly 
Argument 0 is modified as it doubles as a counter
 2019-02-12 15:51:43 +01:00
Martin Kroeker
dc6ac9eab0 Fix declaration of input arguments in the x86_64 s/dGEMV_T and s/dGEMV_N kernels 
Arguments 0 and 1 need to be tagged as both input and output
 2019-02-12 15:33:48 +01:00
Martin Kroeker
32b0f1168e Fix declaration of input arguments in the Sandybridge GER microkernels (#1967) 
* Tag arguments 0 and 1 as both input and output
 2019-01-18 08:11:39 +01:00
Martin Kroeker
b495e54310 Fix declaration of input arguments in the x86_64 SCAL microkernels (#1966) 
* Tag arguments 0 and 1 as both input and output (see #1964)
 2019-01-18 08:11:07 +01:00
Martin Kroeker
d5e6940253 Fix declaration of input arguments in the x86_64 microkernels for DOT and AXPY (#1965) 
* Tag operands 0 and 1 as both input and output

For #1964 (basically a continuation of coding problems first seen in #1292)
 2019-01-17 23:20:32 +01:00
Arjan van de Ven
795285c587 Fix thinko in skylake beta handling 
casting ints is cheaper but it has a rounding, not memory casing effect, resulting in
invalid outcome
 2018-12-24 18:49:50 +00:00
Arjan van de Ven
d321448a63 dgemm: use dgemm_ncopy_8_skylakex.c also for Haswell 
The dgemm_ncopy_8_skylakex.c code is not avx512 specific and gives
a nice performance boost for medium sized matrices
 2018-12-16 23:09:22 +00:00
Arjan van de Ven
c43331ad0a dgemm: Use the skylakex beta function also for haswell 
it's more efficient for certain tall/skinny matrices
 2018-12-16 23:09:17 +00:00
Arjan van de Ven
69d206440a Make the skylakex/haswell sgemm code compile and run even with compilers without avx2 support 2018-12-16 00:19:41 +00:00
Arjan van de Ven
0586899a10 Use sgemm_ncopy_4_skylakex.c also for Haswell 
sgemm_ncopy_4_skylakex.c uses SSE transpose operations where the
real perf win happens; this also works great for Haswell.

This gives double digit percentage gains on small and skinny matrices
 2018-12-15 13:49:19 +00:00
Arjan van de Ven
00dc09ad19 Use the skylake sgemm beta code also for haswell 
with a few small changes it's possible to use the skylake sgemm code
also for haswell, this gives a modest gain (10% range) for smallish
matrixes but does wonders for very skinny matrixes
 2018-12-15 13:49:13 +00:00
Arjan van de Ven
cdc668d82b Add a "sgemm direct" mode for small matrixes 
OpenBLAS has a fancy algorithm for copying the input data while laying
it out in a more CPU friendly memory layout.

This is great for large matrixes; the cost of the copy is easily
ammortized by the gains from the better memory layout.

But for small matrixes (on CPUs that can do efficient unaligned loads) this
copy can be a net loss.

This patch adds (for SKYLAKEX initially) a "sgemm direct" mode, that bypasses
the whole copy machinary for ALPHA=1/BETA=0/... standard arguments,
for small matrixes only.

What is small? For the non-threaded case this has been measured to be
in the M*N*K = 28 * 512 * 512 range, while in the threaded case it's
less, around M*N*K = 1 * 512 * 512
 2018-12-13 13:47:31 +00:00