840e01061f
Merge pull request #1491 from martin-frbg/ddot_mt
...
Add multithreading support for Haswell DDOT
2018-03-27 21:43:05 +02:00
a55694dd5b
Declare dot_compute static to avoid conflicts in multiarch builds
2018-03-16 22:23:36 +01:00
85a41e9cdb
Add multithreading support for Haswell DDOT
...
copied from ashwinyes' implementation in dot_thunderx2t99.c
2018-03-16 16:58:47 +01:00
81215711a2
Re-enable DAXPY microkernels for x86_64
...
as the inaccuracies seen in the original testcase for #1332 appear to be due to an artefact that amplifies the very small rounding differences between FMA and discrete multiply+add
2018-03-04 19:37:03 +01:00
497f0c3d8a
Replace .align with .p2align in the Nehalem microkernels
2018-02-26 20:58:33 +01:00
ea37db828e
Convert .align to .p2align for OSX compatibility
2018-02-26 20:48:03 +01:00
7c1925acec
Use .p2align instead of .align for compatibility on Sandybridge as well
2018-02-24 19:43:15 +01:00
2359c7c1a9
Use .p2align instead of .align for portability
...
The OSX assembler apparently mishandles the argument to decimal .align, leading to a significant loss of performance
as observed in #730 , #901 and most recently #1470
2018-02-24 17:50:13 +01:00
e388459a27
Merge pull request #1419 from brada4/develop
...
Initialize unitialized values for repeated calls
2018-01-31 23:48:34 +01:00
4938faa822
core.IdenticalExpr clang501 checker
2018-01-19 23:15:58 +01:00
42285d8e70
Merge pull request #1410 from brada4/develop
...
Address warnings #1357
2018-01-06 20:02:46 +01:00
4d0b005e5b
Eliminate remaining unused results in kernels (clang5 analyzer)
2018-01-01 20:54:39 +01:00
b81656936f
Merge pull request #1409 from martin-frbg/issue1292-2
...
Tag %1 and %2 as both input and output operands
2017-12-31 20:18:48 +01:00
b973990df2
Tag %1 and %2 as both input and output operands
...
fix from #1292 extended to the other gemv microkernels
2017-12-31 18:03:36 +01:00
1e31124eb0
Merge pull request #1406 from martin-frbg/issue1292
...
Tag %1 and %2 as both input and output
2017-12-30 14:52:03 +01:00
723f396a20
Tag %1 and %2 as both input and output
...
The inline assembly modifies its input operands, so mark them as output to avoid surprises with optimization. Fixes #1292
2017-12-29 23:56:41 +01:00
43c0622e7b
Retire Piledriver/Steamroller/Excavator daxpy microkernels as well
...
related to issue #1332
2017-12-13 18:40:39 +01:00
0623636c98
Use Sandybridge daxpy kernel on Haswell and Zen for now
...
The testcase from #1332 exposes a problem in daxpy_microk_haswell-2.c that is not seen with
any of the other Intel x86_64 microkernels.
2017-12-10 19:24:31 +01:00
281a2b952f
warning cleanup ( #1380 )
...
* dead increments in driver/level2
* dead increments in kernel/generic
* part dead increments in kernel/x86_64
2017-12-05 19:54:10 +01:00
6c77b5f267
Merge pull request #1369 from martin-frbg/dsdot
...
Add optimized dsdot to all other x86_64 kernels that use sdot.c
2017-11-28 18:15:31 +01:00
c92cd6d162
Add trivially optimized dsdot based on sdot
2017-11-24 20:05:27 +01:00
cae5d9a20b
Add trivially optimized dsdot based on sdot
2017-11-24 20:04:29 +01:00
3d891c3106
Add trivially optimized dsdot based on sdot
2017-11-24 20:03:40 +01:00
4fbdcfa823
Add trivially optimized dsdot based on sdot
2017-11-24 20:02:28 +01:00
1bb6a96ebc
Add trivially optimized dsdot based on sdot
2017-11-24 20:01:42 +01:00
6bd163f37a
Add trivially optimized dsdot based on sdot
2017-11-24 20:00:23 +01:00
f0333333d1
Add trivially optimized dsdot based on sdot
2017-11-24 19:59:28 +01:00
e89b979b2c
fix spurious compiler warning fix (no code change)
2017-11-24 18:39:04 +01:00
7e9b29b9b8
fix spurious compiler warning (no code change)
2017-11-24 18:36:37 +01:00
6157d0902a
Merge pull request #1358 from martin-frbg/unused_vars
...
Clean up spurious unused variables in the kernels
2017-11-15 11:31:43 +01:00
3fea849bbf
Remove unused variables from Haswell dtrmm and Bulldozer dtrsm
2017-11-14 23:35:10 +01:00
8f177621bc
Remove unused variables at0...at3 from ?symv_U
2017-11-14 23:32:25 +01:00
5f402b7759
Remove unused (loop?) variable j from the gemv_n_4 implementations
2017-11-14 23:29:42 +01:00
a07807caac
Eliminate loop code when called as/from dsdot
2017-10-25 16:45:41 +02:00
5e3e91d0fc
Split the microkernel workload into chunks of 32 floats for dsdot mode to limit loss of precision
2017-10-22 18:18:51 +02:00
28c3fa8950
Add dsdot
2017-10-16 23:29:03 +02:00
8ac87c1cb6
Implement DSDOT with unchanged sdot microkernels
2017-10-16 23:27:51 +02:00
505b218829
Merge remote-tracking branch 'upstream/develop' into dyn
2017-08-06 19:07:00 +05:30
1d1854032b
Add missing EXCAVATOR
2017-08-02 19:03:04 +05:30
2c51a990ac
Fix extra whitespaces. CMake parser macro fails with it
...
TODO: Fix the parser macro to strip trailing whitespaces
2017-08-02 18:26:57 +05:30
ca17b4b75c
Fix complex support for MSVC headers
2017-07-28 11:50:29 +05:30
c9ff735da6
Add ZEN support (tested for auto-detected static backend)
2017-03-19 15:32:50 +01:00
a6efabf155
Replace gnu _real_ , _imag_ extensions in initializers
2017-03-13 00:38:37 +01:00
dc34a0da96
Merge pull request #915 from mdong/small_fix_for_icc
...
remove input from clobbered list
2017-02-23 20:00:22 +01:00
4998e19869
Change file comments to work around clang 3.9 assembler bug
2016-10-13 16:51:08 +02:00
16446d1d23
Remove explicit include of complex.h
2016-09-29 23:45:56 +02:00
098d8ec5d6
remove input from clobbered list
2016-06-24 16:37:58 -04:00
298b13bba4
updated some kernel files for EXCAVATOR
2016-04-25 10:36:23 +02:00
f24d5307cf
Refs #834 . Fix zgemv config bug on Steamroller.
2016-04-12 22:26:11 +08:00
d4380c1fe4
Refs xianyi/OpenBLAS-CI#10 , Fix sdot for scipy test_iterative.test_convergence test failure on AMD bulldozer and piledriver.
2016-04-07 01:44:18 +08:00
faa5e2e5e3
FIX: forgot the add the files cgemv_n_4.c and cgemv_t_4.c
2016-03-10 11:10:38 +01:00
fdf291be30
Added optimized cgemv_n and cgemv_t kernels for bulldozer, piledriver and steamroller
2016-03-10 09:42:07 +01:00
c99cc41cbd
Added optimized zgemv_n kernel for bulldozer, piledriver and steamroller
2016-03-09 14:02:03 +01:00
acdff55a6a
Bugfix for ztrmv
2016-03-07 09:39:34 +01:00
7d6b68eb4a
Refs #786 . Revert to default assembly kernel.
2016-03-07 11:34:58 +08:00
8f758eeff9
Refs #786 . avoid old assembly c/zgemv kernels.
2016-03-05 08:32:03 +08:00
efa4f5c936
Refs #695 #783 . Replace default x86_64 cgemv_t
...
asm kernel by C kernel.
2016-03-01 11:18:56 +08:00
6e7be06e07
Refs JuliaLang/julia#5728 . Fix gemv performance bug on Haswell Mac OSX.
...
On Mac OS X, it should use .align 4 (equal to .align 16 on Linux).
I didn't get the performance benefit from .align. Thus, I deleted it.
2016-02-19 17:56:07 -05:00
962376664d
Refs #768 . Swap the result of zdot x87 fp kernel.
2016-02-02 09:15:02 +08:00
c44ff4d648
Refs #714 . avoid compiling warnings.
2016-01-28 04:38:07 +08:00
c8f2c5d636
added optimized trsm_kernels
2016-01-05 13:05:05 +01:00
69363622a8
Fix DYNAMIC_ARCH=1 bug.
2015-10-27 05:10:40 +08:00
f874465bb8
Use cmake to build OpenBLAS GENERIC Target on MSVC x86 64-bit.
...
Disable CBLAS and LAPACK.
2015-08-10 14:10:44 -05:00
ab0a0a75fc
Merge branch 'develop' into cmake
2015-08-03 23:59:01 -05:00
1cf2b10224
Use pure C generic target on x86 and x86_64.
...
make TARGET=GENERIC
?gemm3m is unimplemented on generic target.
2015-08-03 23:55:56 -05:00
7ac7e147d4
Fixed cmake building bugs on Linux. Disable LAPACK by default.
2015-08-04 04:37:05 +08:00
e7c969e164
added optimized dtrmm_kernel for haswell
2015-06-13 16:16:29 +02:00
9bd962f655
modified haswell parameter dgemm_unroll_n
2015-06-13 10:28:27 +02:00
24f58c8bb1
added optimized cscal and zscal kernels for steamroller
2015-05-18 12:40:07 +02:00
95b1faf667
added optimized cscal and zscal kernels for steamroller and piledriver
2015-05-18 10:50:57 +02:00
2d9e406050
added optimized cscal kernel for sandybridge
2015-05-18 08:46:06 +02:00
59083e3ce1
added optimized cscal kernel for bulldozer
2015-05-18 07:33:52 +02:00
685be40339
Merge pull request #571 from wernsaar/develop
...
added optimized cscal and zscal functions
2015-05-17 14:09:14 +02:00
31c9e399e9
added optimized cscal kernel for haswell
2015-05-17 13:44:09 +02:00
7de6bb9889
added optimized zscal kernel for bulldozer
2015-05-17 11:45:19 +02:00
d63034303b
added optimized zscal kernel for haswell
2015-05-16 16:41:45 +02:00
51ff17d46e
Add AMD Excavator target.
2015-05-13 16:16:30 -05:00
18e90ee2e3
bugfix: added static to functions
2015-05-13 13:31:26 +02:00
e00cccc41e
added optimized dscal kernel for piledriver
2015-05-13 13:05:35 +02:00
73f09bf64f
optimized dscal kernel for increment != 1
2015-05-13 12:14:39 +02:00
02e772c7e4
added optimized dscal kernel for haswell
2015-05-12 17:19:58 +02:00
7aee913991
added optimized dscal kernel for sandybridge
2015-05-12 16:27:43 +02:00
e50a933037
added optimized dscal kernel for bulldozer
2015-05-12 12:28:44 +02:00
133c11a156
updated dgemv_n kernel for nehalem
2015-04-30 14:38:06 +02:00
30f52d53df
optimized dgemv_n kernel for haswell
2015-04-30 12:11:39 +02:00
5e83d80725
optimized dger kernel for sandybridge
2015-04-28 16:58:11 +02:00
b2e1797dc6
added optimized sger kernel for sandybridge
2015-04-28 15:33:38 +02:00
e216f686cb
optimized saxpy and daxpy for sandybridge
2015-04-28 10:18:32 +02:00
fc0e0391f3
bugfixes: replaced int with BLASLONG
2015-04-24 14:30:44 +02:00
c22068c406
optimized sdot.c for increments != 1
2015-04-24 13:13:20 +02:00
dee100d0e4
optimized saxpy.c for increments != 1
2015-04-24 11:52:59 +02:00
0273966abb
optimized daxpy kernel for increments != 1
2015-04-24 11:39:17 +02:00
3a67daa954
optimized ddot.c for increments != 1
2015-04-24 10:56:55 +02:00
b4f2153dcd
added optimized ssymv kernels for sandybridge
2015-04-23 12:19:24 +02:00
1c4b0eeae3
added optimized ssymv kernels for haswell
2015-04-23 10:23:13 +02:00
1bec9abb9a
added optimized dsymv kernels for sandybridge
2015-04-22 12:09:43 +02:00
3814bf60d3
added optimized dsymv kernels for haswell
2015-04-22 10:42:50 +02:00
6d0db0151f
added optimized zaxpy-kernels
2015-04-16 11:19:37 +02:00
37b9033c90
Merge pull request #543 from jeromerobert/develop
...
Fix a buffer overflow with MAX_STACK_ALLOC size in dgemv_t
2015-04-15 11:18:14 -05:00
13889515b3
added optimized caxpy-kernel for sandybridge
2015-04-15 16:29:25 +02:00
248c9340c3
added optimized caxpy-kernel for haswell
2015-04-15 15:16:31 +02:00
e9f33b4ca7
added optimized caxpy-kernel for steamroller
2015-04-15 13:49:23 +02:00
f5d847122a
updated caxpy_microk_bulldozer-2.c and caxpy.c
2015-04-15 11:59:38 +02:00
a4c96eca67
Fix a buffer overflow with MAX_STACK_ALLOC size in dgemv_t
...
Refs #478 , #482 , 9798481fd9fd42
2015-04-15 11:46:48 +02:00
baa0363ea2
add optimized ddot-kernel for piledriver
2015-04-14 15:09:13 +02:00
34ba66606a
add optimized daxpy-kernel for piledriver
2015-04-14 14:23:29 +02:00
f615dc7603
added optimized saxpy kernel for steamroller
2015-04-14 09:09:39 +02:00
331c417637
optimized saxpy for piledriver
2015-04-14 08:34:11 +02:00
d7a17ad85d
optimized sdot-kernel for pilediver
2015-04-13 13:19:21 +02:00
d35f6c63c2
add optimized daxpy-kernel for steamroller
2015-04-13 12:22:43 +02:00
166d76e864
added optimized sdot-kernel for steamroller
2015-04-11 08:48:18 +02:00
f9f127d838
added optimized ddot kernel for steamroller
2015-04-10 16:18:03 +02:00
62231ab337
Merge pull request #538 from wernsaar/develop
...
Added optimized cdot- and zdot-kernels
2015-04-10 16:03:37 +02:00
3119def9a7
updated cdot and zdot
2015-04-10 11:10:31 +02:00
33b332372a
add optimized cdot- and zdot-kernel for sandybridge
2015-04-10 09:37:26 +02:00
fd838c75bc
add optimized cdot- and zdot-kernel for haswell
2015-04-09 15:13:52 +02:00
b57a60dac8
updated cdot and zdot for piledriver
2015-04-09 10:33:46 +02:00
5c51163972
added optimized cdot- and zdot-kernel for steamroller
2015-04-09 09:45:23 +02:00
9299d8cfd6
added optimized cdot- and zdot-kernels for bulldozer
2015-04-08 16:29:55 +02:00
0a3d3b945d
Refs #535 . Fix the wrong vector instruction in sgemm sandy bridge kernel.
2015-04-08 03:55:49 +08:00
60c6dec6e6
updated some lines for bulldozer
2015-04-06 18:47:16 +02:00
47898cca35
added optimized saxpy- and daxpy-kernel for sandybridge
2015-04-06 16:05:16 +02:00
53bb924287
added optimized saxpy- and daxpy-kernel for haswell
2015-04-06 12:33:16 +02:00
a901b065d3
added optimized ddot-kernel for sandybridge
2015-04-05 20:19:38 +02:00
3937e2a0a0
add optimized sdot-kernel for sandybridge
2015-04-05 19:47:05 +02:00
9707d608d5
removed double definition line
2015-04-05 18:35:34 +02:00
701b9d7556
added optimized sdot- and ddot-kernel for HASWELL
2015-04-05 17:57:53 +02:00
41aad0407f
Merge pull request #482 from jeromerobert/develop
...
Allow to do gemv and ger buffer allocation on the stack
2015-01-02 02:26:17 +08:00
ddf983d643
added optimizations for steamroller
2014-12-30 20:14:45 +08:00
4319769b79
added target processor STEAMROLLER
2014-12-28 20:16:46 +08:00
e9d9a8eae3
Allow to do gemv and ger buffer allocation on the stack
...
ger and gemv call blas_memory_alloc/free which in their turn
call blas_lock. blas_lock create thread contention when matrices
are small and the number of thread is high enough. We avoid
call blas_memory_alloc by replacing it with stack allocation.
This can be enabled with:
make -DMAX_STACK_ALLOC=2048
The given size (in byte) must be high enough to avoid thread contention
and small enough to avoid stack overflow.
Fix #478
2014-12-27 14:33:12 +01:00
587e16fba3
Ref #458 : Backport, sandybrigde uses nehalem zgemm kernel
2014-12-22 17:01:18 +01:00
6261342de3
small optimization on dgemm_kernel for N=1
2014-12-18 20:35:51 +01:00
bc5fff7085
changed inline assembler labels to short form
2014-12-07 12:38:54 +01:00
0cf29ba6d2
Fixed a bug of sgemm sandy bridge kernel.
...
Reported by Julia project. JuliaLang/julia#9084
2014-12-03 17:38:41 +08:00
2fb02626da
Update organization info.
2014-11-25 15:28:58 +08:00
a85c2785ae
Refs #467 . Added generic kernel file for x86_64.
2014-11-24 15:34:48 +08:00
b7c9566eea
removed obsolete gemv kernel files
2014-09-14 11:00:53 +02:00
6df1b0be81
optimized zgemv_n_microk_sandy-4.c
2014-09-14 10:21:22 +02:00
2ac1e076c1
added optimized zgemv_n kernel for sandybridge
2014-09-14 09:02:05 +02:00
9908b6031c
bugfix in KERNEL.PILEDRIVER
2014-09-13 16:26:53 +02:00
8f100a14f2
optimized cgemv_t kernel for haswell
2014-09-13 16:13:27 +02:00
53b5726b04
added optimized cgemv_t kernel for haswell
2014-09-13 15:14:12 +02:00
1a352b24e6
updated KERNEL.HASWELL
2014-09-13 12:23:27 +02:00
5194818d4b
updated zgemv_t_4.c
2014-09-13 09:48:34 +02:00
8a39cdb1c1
added optimized zgemv_t kernel for haswell
2014-09-13 09:47:07 +02:00
0a1390f2d8
enabled optimized zgemv_t kernel for bulldozer
2014-09-12 17:43:47 +02:00
a8b0812feb
optimized zgemv_t for bulldozer
2014-09-12 17:42:25 +02:00
a0fb68ab42
added optimized zgemv_t kernel for bulldozer
2014-09-12 17:04:22 +02:00
44c11165d5
bugfix in cgemv_t_4.c
2014-09-12 14:12:24 +02:00
564be4eb72
added optimized cgemv_t kernel
2014-09-12 13:38:01 +02:00
107c3ea7d5
added optimized zgemv_t routine
2014-09-12 12:35:20 +02:00
bb8d698335
optimized zgemv_n_microk_haswell-4.c for small size
2014-09-11 13:44:55 +02:00
e0192a6914
bugfix in zgemv_n_4.c
2014-09-11 13:18:00 +02:00
bced4594bb
added optimized zgemv_n kernel
2014-09-11 12:34:57 +02:00
cafba99b6b
bufix in cgemv_n_microk_haswell-4.c
2014-09-11 11:12:44 +02:00
ac8f232b2a
more optimizations
2014-09-11 10:25:48 +02:00
f98e1244c4
optimized cgemv_n_4.c
2014-09-10 19:26:14 +02:00
be95700b30
added optimized cgemv_kernel for haswell
2014-09-10 14:11:24 +02:00
4aa534ae93
added cgemv_n kernel, optimized for small sizes
2014-09-10 13:45:13 +02:00
baa46e4fba
added and tested optimized dgemv_n kernel for haswell
2014-09-09 16:17:45 +02:00
faab7a181d
added optimized dgemv_n kernel for haswell
2014-09-09 15:32:32 +02:00
8109d8232c
optimized dgemv_t kernel for haswell
2014-09-09 14:38:08 +02:00
debc6d1a05
bugfix in KERNEL.HASWELL
2014-09-09 14:04:44 +02:00
e73a0113ec
added optimized gemv kernels
2014-09-09 13:54:55 +02:00
44f2bf9bae
added optimized dgemv_t kernel for haswell
2014-09-09 13:34:22 +02:00
cd34e9701b
removed obsolete files
2014-09-08 19:15:31 +02:00
658939faaa
optimized dgemv_n kernel for small sizes
2014-09-08 15:22:35 +02:00
c4d9d4e5f8
added haswell optimized kernel
2014-09-08 12:25:16 +02:00
7c0a94ff47
bugfix in sgemv_n_microk_haswell-4.c
2014-09-08 10:54:33 +02:00
cbbc80aad3
added optimized sgemv_t kernel for haswell
2014-09-08 10:13:39 +02:00
2be5c7a640
bugfix for windows
2014-09-07 21:48:42 +02:00
80f7786875
enabled optimized sgemv kernels for piledriver
2014-09-07 21:13:57 +02:00
553e275407
optimized sgemv_n kernel for sandybridge
2014-09-07 20:53:30 +02:00
7b3932b3f3
optimized sgemv_n kernel for nehalem
2014-09-07 19:20:08 +02:00
75207b1148
optimized sgemv_n for very small size of m
2014-09-07 18:23:48 +02:00
274828fa50
optimizations for very small sizes
2014-09-07 13:45:03 +02:00
5ae1731fe6
better optimzations for sgemv_t kernel
2014-09-06 21:28:57 +02:00
c8eaf3ae2d
optimized sgemv_t_4 kernel for very small sizes
2014-09-06 19:41:57 +02:00
3a7ab47ee9
optimized sgemv_t
2014-09-06 18:34:25 +02:00
cf5544b417
optimization for small size
2014-09-06 13:17:56 +02:00
d143f84dd2
added optimized sgemv_n kernel for haswell
2014-09-06 12:08:48 +02:00
a64fe9bcc9
added optimized sgemv_n kernel for sandybridge
2014-09-06 08:41:53 +02:00
6df7a88930
optimized sgemv_t for sandybridge
2014-09-05 10:22:50 +02:00
53de943690
bugfix for sgemv_n_4.c
2014-09-04 18:55:52 +02:00
7f910010a0
optimized sgemv_n kernel for small sizes
2014-09-04 13:09:27 +02:00
3a5d8dbff9
optimized sgemv_n_4.c
2014-09-03 15:34:30 +02:00
2a60c6d4b0
optimized sgemv_n for small sizes
2014-09-03 14:48:45 +02:00
0fc560ba23
bugfix for buffer overflow
2014-09-03 10:13:47 +02:00
f3b50dcf5b
removed obsolete instructions from sgemv_t_4.c
2014-09-02 13:35:41 +02:00
93eaba959d
optimized sgemv_t for bulldozer
2014-09-02 12:42:36 +02:00
9570e56965
optimized sgemv_t_4.c for small sizes
2014-09-01 15:11:37 +02:00
bc99faef1b
optimized sgemv_t_4.c for uneven sizes
2014-08-31 14:33:15 +02:00
848c0f16f7
optimized sgemv_t_4.c for small size
2014-08-31 13:23:44 +02:00
53e6dbf6ca
optimized sgemv_t kernel for small sizes
2014-08-30 13:36:27 +02:00
20cd850125
modification for clang compiler
2014-08-27 09:00:20 +02:00
3885eebdb8
added optimized zaxpy bulldozer kernel
2014-08-25 15:52:35 +02:00
ee74445155
added optimized caxpy kernel for bulldozer
2014-08-25 14:53:28 +02:00
9d2ace8bac
added optimized daxpy kernel for bulldozer
2014-08-24 10:57:12 +02:00
b55f997302
added optimized daxpy kernel for nehalem
2014-08-23 17:53:07 +02:00
e45c960c2c
added optimized saxpy kernel for nehalem
2014-08-23 17:15:21 +02:00
ac76b6267f
added optimized dgemv_n kernel for nehalem
2014-08-23 10:40:57 +02:00
f1b96c4846
added optimized ddot kernel for bulldozer
2014-08-22 21:19:29 +02:00
16d6be852d
added optimized ddot kernel for nehalem
2014-08-22 20:34:41 +02:00
95a707ced3
update of KERNEL.BULLDOZER
2014-08-22 17:01:27 +02:00
5d97b0754c
added optimized sdot kernel for nehalem
2014-08-22 17:00:26 +02:00
8a9e868919
added optimized sdot for bulldozer
2014-08-22 14:29:17 +02:00
c8b0645266
added optimized symv_L kernels for nehalem
2014-08-21 14:27:00 +02:00
ec05ff3f64
added optimized ssymv_L kernel for bulldozer
2014-08-21 13:32:06 +02:00
f6f9122660
added optimized dsymv_L kernel for bulldozer
2014-08-21 13:02:53 +02:00
8247f38dc1
added optimized dsymv_U kernel for nehalem
2014-08-20 09:58:04 +02:00
ef6374196d
updated optimized dsymv_U kernel for bulldozer
2014-08-20 09:00:56 +02:00
f824c2b751
updated optimized ssymv_U for bulldozer
2014-08-19 19:25:03 +02:00
4ba4ab623f
added optimized ssymv_U kernel for nehalem
2014-08-19 17:09:45 +02:00
4f39447c05
added optimized ssymv_U kernel for bulldozer
2014-08-18 13:52:24 +02:00
74c9465672
added optimized dsymv_U kernel for bulldozer
2014-08-18 12:18:10 +02:00
11eab4c019
added optimized cgemv_n for haswell
2014-08-14 19:00:30 +02:00
4568d32b6b
added optimized cgemv_t kernel for haswell
2014-08-14 14:10:29 +02:00
c1a6374c6f
optimized zgemv_n kernel for sandybridge
2014-08-13 16:10:03 +02:00
2470129132
added fast return, if m or n < 1
2014-08-13 13:54:19 +02:00
8c582d362d
optimized zgemv_t_microk_haswell-2.c
2014-08-13 13:42:22 +02:00
11e34ddd1b
bugfix for zgemv_n_microk_haswell-2.c
2014-08-13 12:54:18 +02:00
9528f0d9ee
bugfix in zgemv_n_microk_sandy-2.c
2014-08-13 12:18:03 +02:00
b06550519e
added optimized cgemv_t c-kernel
2014-08-12 12:15:41 +02:00
6093ee5363
bugfix in zgemv_n_microk_haswell-2.c
2014-08-12 10:02:25 +02:00
07c66b1960
modified algorithm for better numerical stability
2014-08-12 08:35:42 +02:00
58b075daef
added optimized zgemv_t kernel for haswell
2014-08-11 16:57:52 +02:00
09fcd3a341
add optimized zgemv_t kernel for bulldozer
2014-08-11 14:19:25 +02:00
726ad085cb
added optimized zgemv_t for haswell
2014-08-11 13:10:12 +02:00
6fe416976d
added optimimized zgemv_t c-kernel
2014-08-11 09:13:18 +02:00
dbc2eff029
disabled optimized haswell zgemv_n kernel for windows ( bad rounding )
2014-08-10 11:57:24 +02:00
462b4885ff
added optimized zgemv_n kernel for haswell
2014-08-10 08:39:17 +02:00
aa54fe064c
added zgemv_n c-function
2014-08-07 22:30:20 +02:00
006ef3ea01
added optimized dgemv_t kernel for haswell
2014-08-07 10:08:54 +02:00
60f17628cc
added optimized dgemv_n kernel for haswell
2014-08-07 09:18:02 +02:00
c9bad1403a
added optimized sgemv_t kernel for sandybridge
2014-08-07 07:49:33 +02:00
2f8927376f
enabled optimized nehalem sgemv_t kernel for windows
2014-08-06 16:58:21 +02:00
d945a2b06d
added optimized sgemv_t kernel for nehalem
2014-08-06 16:21:48 +02:00
ca6c8d06ce
enabled optimized sgemv kernels for windows
2014-08-06 14:24:36 +02:00
7aa43c8928
enabled optimized sgemv kernels for windows
2014-08-06 14:06:30 +02:00
891b960854
added optimized sgemv_t kernel for haswell
2014-08-06 13:42:41 +02:00
95a8caa2f3
added optimized sgemv_t kernel
2014-08-06 12:12:17 +02:00
8c05b8105b
bugfix in sgemv_n.c
2014-08-05 20:14:29 +02:00
c80084a98f
changed default x86_64 sgemv_n kernel to sgemv_n.c
2014-08-05 19:42:56 +02:00
2bab92961f
enabled optimized sgemv_n kernels for windows
2014-08-05 14:52:54 +02:00
9175b8bd5f
changed long to blaslong for windows compatibility
2014-08-05 13:28:39 +02:00
793f2d43b0
added optimized sgemv_n kernel for nehalem
2014-08-05 10:50:08 +02:00
a4dde45f87
optimized sgemv_n kernel for sandybridge
2014-08-05 08:53:09 +02:00
7fa7ea3e1e
updated haswell optimized sgmv_n kernel
2014-08-05 08:04:47 +02:00
3fbc13eb65
modified sgemv_n for haswell
2014-08-04 16:22:11 +02:00
db6917303f
added a better optimized sgemv_n kernel for bulldozer and piledriver
2014-08-04 14:29:01 +02:00
5087096711
optimization of sandybridge cgemm-kernel
2014-07-29 19:07:21 +02:00
46bc4fd50c
optimized cgemm kernel for haswell
2014-07-29 08:53:09 +02:00
1cc02b4337
optimized sgemm kernel for haswell
2014-07-28 11:50:01 +02:00
1d33547222
optimized zgemm kernel for haswell
2014-07-27 11:51:42 +02:00
6acbafe45b
added sgemv_n microkernel for haswell
2014-07-20 14:52:25 +02:00
5392d11b04
optimized sgemv_n_microk_sandy.c
2014-07-20 14:08:04 +02:00
c0fe95fb72
added sgemv_n microkernel for sandybridge
2014-07-20 13:17:47 +02:00
d9d4077c93
added sgemv_t microkernel for haswell
2014-07-20 11:30:32 +02:00
02eb72ac42
bugfix in sgemv_t_microk_sandy.c
2014-07-20 10:48:41 +02:00
c06f9986d4
added sgemv_t microkernel for sandybridge
2014-07-20 10:21:08 +02:00
2cce125c79
added optimized sgemv_t for bulldozer and piledriver
2014-07-19 15:48:07 +02:00
b3938fe371
don't use this sgemv_n on Windows
2014-07-19 07:15:34 +02:00
c8a4a56177
performance optimizations for sgemv_n
2014-07-18 11:25:21 +02:00
3c5732615d
added blocked sgemv_n and microkernel for bulldozer and piledriver
2014-07-17 23:15:07 +02:00
880597b301
segment violation in sgemv kernels
2014-07-13 10:46:14 +02:00
13348b2137
removed reference to daxpy_bulldozer kernel (Windows bug in lapack-test)
2014-07-06 16:39:32 +02:00
d5b976f92d
fallback to zgemm_kernel_4x2_sse.S
2014-07-06 11:05:28 +02:00
e0c080a28c
removed reference to zgemm_kernel_4x2_sse3.S (bug in lapack-test)
2014-07-05 16:13:17 +02:00
b079df9ef4
added optimized sdot- and dsdot-kernel, written in C
2014-06-30 14:46:38 +02:00
01a119abfc
enabled SMP for sbmv and zsbmv, but only for 64bit binaries
2014-06-29 20:35:56 +02:00
99efbbbad5
Fixed #395 . Enable optimized cgemm for Sandybridge. Added optimized sdot kernel.
...
Fixed c/zgemm, zgemv computational error of haswell, piledriver, bullldozer, and
barcelona on Windows.
Merge branch 'develop' of https://github.com/wernsaar/OpenBLAS into wernsaar-develop
Conflicts:
kernel/Makefile.L1
kernel/x86_64/KERNEL
param.h
2014-06-29 10:34:51 +08:00
22e5aee2dd
fixed zgemv bug for older AMD Processors
2014-06-28 19:04:49 +02:00
35d37e124f
bugfix for barcelona zgemv-kernel
2014-06-28 12:36:11 +02:00
d8ba46efdb
bugfix for bulldozer cgemm-, zgemm- and zgemv-kernel
2014-06-28 12:16:20 +02:00
a15f22a1f6
bugfix for piledriver cgemm-, zgemm- and zgemv-kernel
2014-06-28 11:46:58 +02:00
b94ea89f52
bugfix for haswell cgemm- and zgemm-kernel
2014-06-28 10:22:40 +02:00
35f668bb14
bugfix for cgemm_kernel_8x2_sandy.S
2014-06-28 10:01:56 +02:00
6c2ead30f0
Remove all trailing whitespace except lapack-netlib
...
Signed-off-by: Timothy Gu <timothygu99@gmail.com>
2014-06-27 12:05:18 -07:00
365e8de346
added optimized cgemm-kernel for SANDYBRIDGE
2014-06-27 13:40:29 +02:00
578d1b6219
added DSDOT definition and enabled optimized sdot kernel
2014-06-27 11:30:29 +02:00
dabab2b5f4
added new optimized sgemm kernel for SANDYBRIGE
2014-06-26 21:42:08 +02:00
aa2709c4e0
enabled optimized dgemm kernel for NEHALEM
2014-06-26 12:22:29 +02:00
a13bcc1716
enabled optimized sgemv kernel for barcelona and piledriver
2014-06-25 13:50:57 +02:00
d2c82d7543
enabled optimized sgemv kernel for HASWELL
2014-06-25 12:56:45 +02:00
0517672dd0
enabled optimized sgemv kernels for nehalem, sandybridge and bulldozer
2014-06-25 12:38:14 +02:00
23203d52c1
Ref #380 : lowered stack usage for haswell kernels
2014-06-19 14:31:52 +02:00
73545a79cd
Ref #380 : lowered stack usage for piledriver and bulldozer kernels
2014-06-19 14:02:14 +02:00
5f3b68b4d4
replaced sgemm and cgemm kernels because lapack bugs
2014-05-10 11:24:07 +02:00
2424af62fd
replaced dgemm-kernel because bug in lapack
2014-05-10 10:52:37 +02:00
793509a3b5
replaced files for sdot, sgemv_n and sgemv_t for bug #348
2014-05-06 15:29:39 +02:00
47b22763f8
reduced stack usage on windows to 16K
2014-04-24 14:09:26 +02:00
9a557e90da
Refs #340 . Fixed SEGFAULT bug of dgemv_n on OSX.
2014-02-15 23:23:15 +08:00
2d557eb1e0
Fixed computational error of dgemv_n.
2014-02-04 21:47:51 +08:00
05bb391c3a
Refs #330 . Fixed the compatible issue with clang on Mac OSX.
2013-12-16 20:31:17 +08:00
9b5be29886
Refs #310 . Fixed Segfault bug on nehalem when Julia calling dgeqrt3 on OSX.
...
Please also check JuliaLang/julia#4099
Julia test script:
A=rand(256, 256)
qrfact(A)
I found this was a bug in kernel/x86_64/dgemm_ncopy_8.S.
However, I cannot use gdb with julia. Thus, this is a walkaround fix.
2013-12-12 23:23:04 +08:00
034a5b2083
modified zsymv
2013-12-01 21:07:49 +01:00
27d4234d4d
merged symv
2013-12-01 20:56:02 +01:00
b3254eecaf
Merge remote branch 'origin/haswell' into develop
2013-12-01 18:09:12 +01:00
0b6e13b689
Merge remote branch 'origin/develop' into haswell
2013-12-01 13:38:11 +01:00
e09dc279a2
Merge remote branch 'origin/develop' into piledriver
2013-12-01 13:33:18 +01:00
5c648a8984
Merge remote branch 'origin/develop' into haswell
2013-12-01 11:25:33 +01:00
c44dc4dd3c
Merge remote branch 'origin/develop' into piledriver
2013-12-01 11:06:36 +01:00
f1db386211
changes for compatibility with Pathscale compiler
2013-11-13 17:59:11 +01:00
6da558d2ab
changes for compatibility with Pathscale compiler
2013-11-13 17:39:13 +01:00
2f5fdd2000
Refs #314 . Fixed clang compiling bug on OSX.
2013-11-07 08:12:03 +08:00
5118a7f4d1
small optimizations on dgemm_kernel for Piledriver
2013-10-31 11:53:26 +01:00
e172b70ea2
added cgemm_kernel for Piledriver
2013-10-31 08:38:17 +01:00
1cf4b974b2
added zgemm_kernel for Piledriver
2013-10-30 09:12:17 +01:00
7bccff1512
added sgemm_kernel for PILEDRIVER
2013-10-29 22:53:04 +01:00
afe44b0241
tests and code cleanup of gemm_kernels for HASWELL
2013-10-28 14:23:48 +01:00
a77c71eaf5
added highly optimized dgemm_kernel for HASWELL
2013-10-28 10:23:47 +01:00
fe8c5666f9
optimized dgemm_kernel for HASWELL
2013-10-20 16:52:26 +02:00
f6b50057e2
corrected and testet FMA3 Code
2013-10-19 10:52:20 +02:00
2840d56aeb
added dgemm_kernel for Piledriver
2013-10-19 09:47:15 +02:00
beffee7d91
Fixed buffer overflow bug in kernel/x86_64/dgemv_t.S file.
2013-10-11 03:20:20 +08:00
6c4a7d0828
Import AMD Piledriver DGEMM kernel generated by AUGEM.
...
So far, this kernel doesn't deal with edge.
AUGEM: Automatically Generate High Performance Dense Linear Algebra
Kernels on x86 CPUs.
Qian Wang, Xianyi Zhang, Yunquan Zhang, and Qing Yi. In the
International Conference for High Performance Computing, Networking,
Storage and Analysis (SC'13). Denver, CO. Nov, 2013.
2013-08-25 10:16:01 -03:00
067e8417fd
removed unnessesary instructions from zgemm_kernel_2x2_bulldozer.S
2013-08-23 22:22:43 +08:00
a82da3d069
removed unnessesary instructions
2013-08-23 22:22:27 +08:00
1569bf14f8
Refs #282 . Fixed zgemv_n typo bug on Win64.
2013-08-23 16:27:17 +08:00
f51a849d91
Merge pull request #278 from wernsaar/haswell
...
Merge wernsaar's Haswell gemm kernels.
2013-08-17 08:24:37 -07:00
44ef70420c
added cgemm_kernel_8x2_haswell.S
2013-08-16 18:54:56 +02:00
d488b1b1aa
added zgemm_kernel_4x2_haswell.S
2013-08-16 10:29:47 +02:00
2b8ab8f55b
sgemm_kernel_16x4_haswell.S minor changes
2013-08-14 01:44:41 +02:00
1cb9579cd0
added zgemm_kernel_4x2_haswell.S and fixed a bug in sgemm_kernel_16x4_haswell.S
2013-08-14 01:23:15 +02:00
2638370844
Init code base for Intel Haswell.
2013-08-13 00:54:59 +08:00
89637f87c8
added sgemm- and dgemm-kernel for HASWELL processor
2013-08-12 18:04:10 +02:00
c0159d44a3
Merge branch 'develop' of https://github.com/wernsaar/OpenBLAS into wernsaar-develop
2013-08-09 10:48:46 +08:00
c17a850c1c
modified KERNEL.BULLDOZER
2013-08-08 17:49:30 +02:00
099853fff6
added dtrsm_kernel_RN_8x2_bulldozer.S
2013-08-08 07:14:08 +02:00
44d23881b5
dtrsm_kernel_LT_8x2_bulldozer.S performance optimization
2013-08-05 11:27:16 +02:00
32fb6b9bb2
Merge branch 'develop' of https://github.com/wernsaar/OpenBLAS into wernsaar-develop
2013-08-05 16:09:47 +08:00
aaeb8eaecd
modified dtrsm_kernel_LT_8x2_bulldozer.S
2013-08-04 12:16:12 +02:00
8aeec32ea0
modified dtrsm_kernel_LT_8x2_bulldozer.S
2013-08-04 10:15:33 +02:00
87fc9de572
added dtrsm_kernel_LT_8x2_bulldozer.S
2013-08-04 09:54:40 +02:00
564aa60fec
removed dtrsm_kernel_LT_8x2_bulldozer.S
2013-08-03 15:40:51 +02:00
f645665dd6
fixed bug in dgemv_t_bulldozer.S
2013-08-03 12:19:29 +02:00
e45a347cd2
repaired trmm bug in sgemm_kernel_16x2_bulldozer.S
2013-08-03 11:43:25 +02:00
99727ac013
repaired trmm bug in cgemm_kernel_4x2_bulldozer.S
2013-08-03 10:32:51 +02:00
6e0a2fbc0c
repaired trmm bug in zgemm_kernel_2x2_bulldozer.S
2013-08-03 10:17:08 +02:00
0a22f99c58
repaired trmm bug in dgemm_kernel_8x2_bulldozer.S
2013-08-03 09:35:39 +02:00
84bd0aabaa
added dtrsm_kernel_LT_8x2_bulldozer.S
2013-07-28 16:47:58 +02:00
72b1edaf1b
Merge branch 'develop' into bulldozer
...
Conflicts:
kernel/x86_64/KERNEL.BULLDOZER
2013-07-28 06:38:25 +02:00
1b3b9e841d
Fixed a computational error in zgemm_kernel_4x4_sandy.S file.
2013-07-18 20:23:21 +08:00
886cbaf4e4
Support AMD Piledriver by bulldozer kernels.
2013-07-06 12:06:43 -03:00
57944538b6
Use ALIGN_5 instead of .algin 32 in assembly kernel. Added ALIGN_5 for 32-bit OSX.
2013-07-01 16:09:05 +08:00
fb298b34ae
Merge pull request #235 from wernsaar/develop
...
Added ddot, daxpy, dcopy kernels for AMD bulldozer.
2013-06-21 17:59:26 -07:00
16012767f4
added dcopy_bulldozer.S
2013-06-21 16:06:51 +02:00
bcbac31b47
added ddot_bulldozer.S
2013-06-20 16:15:09 +02:00
8dc0c72583
added daxpy_bulldozer.S
2013-06-20 14:07:54 +02:00
89405a1a0b
cleanup of dgemm_ncopy_8_bulldozer.S
2013-06-19 19:31:38 +02:00
4f2b12b8a8
added dgemv_t_bulldozer.S
2013-06-19 17:32:42 +02:00
646e168d26
Merge pull request #233 from wernsaar/develop
...
added dgemv_n and some faster gemm_copy routines to BULLDOZER.
2013-06-18 20:02:36 -07:00
93dbbe1fb8
added dgemm_ncopy_8_bulldozer.S
2013-06-18 13:29:23 +02:00
a135f5d9ed
added gemm_tcopy_2_bulldozer.S
2013-06-18 11:01:33 +02:00
d0b6299b13
added dgemm_tcopy_8_bulldozer.S
2013-06-17 14:19:09 +02:00
9e58dd509e
added gemm_ncopy_2_bulldozer.S
2013-06-17 12:55:12 +02:00
7c8227101b
cleanup of dgemv_n_bulldozer.S and optimization of inner loop
2013-06-16 12:50:45 +02:00
f67fa62851
added dgemv_n_bulldozer.S
2013-06-15 16:42:37 +02:00
cd1d473ba0
Merge pull request #230 from wernsaar/develop
...
Refs #230 . New dgemm and sgemm Kernel for BULLDOZER
2013-06-13 07:29:27 -07:00
0ded1fcc1c
performance optimizations in sgemm_kernel_16x2_bulldozer.S
2013-06-13 11:35:15 +02:00
a789b588cd
added cgemm_kernel_4x2_bulldozer.S
2013-06-12 15:55:27 +02:00
8eaa04acbb
added zgemm_kernel_2x2_bulldozer.S
2013-06-11 12:00:49 +02:00
d65bbec99b
added new sgemm kernel for BULLDOZER
2013-06-09 15:57:42 +02:00
e4c39c7c26
changed stack touching
2013-06-08 10:43:08 +02:00
25491e42f9
New dgemm kernel for BULLDOZER: dgemm_kernel_8x2_bulldozer.S
2013-06-08 09:40:17 +02:00
9f59f384d8
Refs #223 . Fixed s/dgemv bug on windows.
2013-06-04 16:01:05 +08:00
23965f164c
Fixed overflow internal buffer bug of (s/d/c/z)gemv on x86_64.
2013-05-29 19:48:31 +08:00
69aa6c8fb1
bad performance with some data
2013-04-28 11:14:23 +02:00
60b263f3d2
removed trsm_kernel_RT_4x4_bulldozer.S. wrong results
2013-04-27 17:23:08 +02:00
7ac306e0da
added trsm_kernel_RT_4x4_bulldozer.S
2013-04-27 16:48:48 +02:00
4cb454cdf2
added trsm_kernel_LT_4x4_bulldozer.S
2013-04-27 14:30:00 +02:00
19ad2fb128
prefetch improved. Defined 2 different kernels for inner loop
2013-04-27 13:40:49 +02:00
6821677489
minor improvements and code cleanup
2013-04-26 20:05:42 +02:00
3326f3152c
Merge pull request #213 from wernsaar/develop
...
Merged some improvements into dgemm_kernel_4x4_bulldozer.S.
2013-04-17 23:56:09 -07:00
7641f6e253
Merged some improvements into dgemm_kernel_4x4_bulldozer.S.
...
Changed the copy functions to generic to solve prefetch conflicts
2013-04-16 19:05:06 +02:00
3ad29452d1
Merge pull request #211 from wernsaar/develop
...
New version of dgemm_kernel_4x4_bulldozer.S
2013-04-15 00:20:55 -07:00
6e3f6f25a5
New version of dgemm_kernel_4x4_bulldozer.S
...
The peak performance with 8 cores is now 90 GFlops
2013-04-12 17:55:51 +02:00
724ae159ce
Fixed the Windows x86_64 ABI bug in s/daxpy kernels.
2013-03-08 22:28:34 +08:00
f300ce3df5
new optimization of dgemm kernel for bulldozer: 10% performance increase
2013-03-06 17:26:03 +01:00
66e64131ed
optimized again bulldozer dgemm kernel
2013-03-05 19:51:37 +01:00
9405f26f4b
new dgemm_kernel for bulldozer
2013-03-04 17:37:38 +01:00
5c8bf6ae0e
Merge branch 'bulldozer' into develop
2013-02-10 01:19:42 +08:00
a1ead62f28
Disable the warning of sgemm bulldozer kernel.
2013-02-09 17:03:13 +01:00
0133580148
Used sgemm bulldozer kernel on 64 bit.
2013-02-09 16:29:14 +01:00
274246651d
Merge branch 'bulldozer' of git://github.com/wernsaar/OpenBLAS into bulldozer
2013-02-09 16:25:07 +01:00
299b5a44dc
Merge branch 'develop' of github.com:xianyi/OpenBLAS into bulldozer
2013-02-09 16:22:04 +01:00
d311236dfd
Refs #189 . Fixed the bug of s/cdot about invalid reading NAN on x86_64.
2013-01-25 20:56:14 +08:00
99d1978df7
Fixed #180 . the typos in kernel/x86_64/sgemv_t.S
2013-01-12 12:31:14 +08:00
08bf6674d5
Refs #177 . Fixed sgemv_t compiling bug on Win64.
2013-01-05 11:36:39 +08:00
fd3046b32a
Refs #173 . Fixed overflow internal buffer bug of gemv_t on x86.
2012-12-23 21:47:22 +08:00
d48cff8cf1
Added optimized sgemm_kernel
2012-12-08 18:50:53 +01:00
f19af5ecc0
Refs #54 . Added AMD Bulldozer x86_64 dgemm kernel developed by Werner Saar <wernsaar at googlemail.com>
...
Based on the dgemm kernel for AMD Barcelona, he used AVX and FMA4 instructions.
Thank Werner Saar!
2012-12-07 01:05:11 +08:00
bfaaa975e6
Added BULLDOZER target. So far it uses barcelona kernels.
2012-12-07 00:53:31 +08:00
b7c0fa6bd2
Init AMD Bulldozer codebase.
2012-12-06 07:29:54 -05:00
cea1a885b5
Refs #154 . Fixed the build bug of dgemv_t on MinW64.
2012-11-27 07:24:04 +08:00
5f0117385e
Refs #154 . Fixed a SEGFAULT bug of dgemv_t when m is very large.
...
It overflowed the internal buffer. Thus, we split vector x into blocks when m is very large.
Thank @wangqian for this patch.
2012-11-19 22:32:27 +08:00
857a0fa0df
Fixed the issue of mixing AVX and SSE codes in S/D/C/ZGEMM.
2012-06-25 19:00:37 +08:00
d34fce56e4
Refs #83 Fixed S/DGEMM calling conventions bug on windows.
2012-06-20 19:53:18 +08:00
6cfcb54a28
Fixed align problem in S and C precision GEMM kernels.
2012-06-20 07:38:39 +08:00
Martin Kroeker
Andrew
Isuru Fernando
Denis Steckelmacher
mdong
Werner Saar
Zhang Xianyi
Jerome Robert
Jerome Robert
Timothy Gu
wangqian