Jia-Chen
|
b610d2de37
|
optimize cgemm on ARM cortex A53 & cortex A55
|
2021-12-12 17:22:52 +08:00 |
Martin Kroeker
|
697e2752d7
|
Merge pull request #3464 from binebrank/arm_sve_sgemm
Add sgemm part for Arm SVE
|
2021-12-11 20:35:22 +01:00 |
Bine Brank
|
a8f62a347b
|
fix UNROLL_MN and add to targets for SVE
|
2021-12-11 16:37:23 +01:00 |
|
Bine Brank
|
774267fdac
|
adjust Makefile.L3 for SVE
|
2021-12-11 16:35:08 +01:00 |
Rafael Cardoso Fernandes Sousa
|
23a7561353
|
Fix error cmake (small kernels)
|
2021-12-09 09:57:39 -06:00 |
|
Martin Kroeker
|
5378046abd
|
roll back DGEMM kernels to 4x8 when compiling for DYNAMIC_ARCH
|
2021-12-06 19:43:54 +01:00 |
|
Bine Brank
|
a1fea1fe2a
|
sgemm v2x8 SVE kernel
|
2021-12-05 18:47:29 +01:00 |
|
Bine Brank
|
abe1ce3434
|
strmm sve v1x8 kernel
|
2021-12-05 14:03:08 +01:00 |
|
Martin Kroeker
|
54d321d742
|
Merge pull request #3466 from rafaelcfsousa/rafael/small_matrix_p10
[POWER] Add small matrix for sgemm/dgemm on Power10
|
2021-12-03 12:12:20 +01:00 |
|
Martin Kroeker
|
0882db30a2
|
Merge pull request #3455 from cenewcombe/develop
Fix unsafe read during final iteration of zsymv_L_sse2.S
|
2021-12-03 10:01:20 +01:00 |
|
Bine Brank
|
0de36f7b5c
|
trmm sve copy fucntions for single precision
|
2021-11-29 21:25:05 +01:00 |
|
Rafael Cardoso Fernandes Sousa
|
c78fdcc80d
|
[POWER] Add support for SMALL_MATRIX_OPT
|
2021-11-28 12:41:16 -06:00 |
|
Bine Brank
|
86ae89bf33
|
add sgemm kernel and copy functions for sgemm and ssymm
|
2021-11-28 18:12:47 +01:00 |
|
Martin Kroeker
|
454edd741c
|
Merge pull request #3425 from binebrank/arm_sve_dgemm
Add dgemm kernel for arm64 SVE
|
2021-11-26 16:14:55 +01:00 |
|
Martin Kroeker
|
bcfbdc81b2
|
Merge pull request #3459 from rafaelcfsousa/fix_cmake
Fix issues when building OpenBLAS with cmake
|
2021-11-26 15:19:24 +01:00 |
|
Bine Brank
|
1af73ce38e
|
Adapt CMake for SVE
|
2021-11-26 10:35:01 +01:00 |
|
Martin Kroeker
|
e7fca060db
|
Merge pull request #3457 from wjc404/optimize-A53-dgemm
MOD: optimize zgemm on cortex-A53/cortex-A55
|
2021-11-26 10:30:47 +01:00 |
|
Jia-Chen
|
5c1cd5e0c2
|
MOD: add comments to a53 zgemm kernel
|
2021-11-25 22:48:48 +08:00 |
|
Rafael Cardoso Fernandes Sousa
|
d5c9353f1b
|
Modify the order that cmake set the KERNEL variables (generic now is fallback)
|
2021-11-24 20:08:35 -06:00 |
|
Jia-Chen
|
9f59b19fcd
|
MOD: optimize zgemm on cortex-A53/cortex-A55
|
2021-11-24 21:51:45 +08:00 |
|
Bine Brank
|
531a28b6a0
|
removed unused code (compiler warnings)
|
2021-11-22 10:12:34 +01:00 |
|
Bine Brank
|
9b9cb90bb1
|
modify Makefile for SVE copy
|
2021-11-22 09:54:20 +01:00 |
|
Bine Brank
|
9388f05a3c
|
configure SVE Makefile
|
2021-11-21 18:33:43 +01:00 |
|
Bine Brank
|
b58d4f31ab
|
some clean-up & commentary
|
2021-11-21 14:56:27 +01:00 |
|
Martin Kroeker
|
b7df500106
|
Add generic mips32 target
|
2021-11-20 17:31:51 +01:00 |
|
Bine Brank
|
e6ed4be02e
|
symm SVE copy rutines
|
2021-11-20 16:35:29 +01:00 |
Caroline Newcombe
|
feeb8283a5
|
Fix unsafe read during final iteration of zsymv_L_sse2.S
|
2021-11-19 14:29:32 -06:00 |
|
Jia-Chen
|
302f22693a
|
MOD: optimize normal DGEMM on ARMV8 cortex-A53 & cortex-A55
|
2021-11-18 21:14:43 +08:00 |
|
Bine Brank
|
3c7eed0e53
|
add remaining trmm copy rutines for SVE
|
2021-11-14 16:00:10 +01:00 |
|
Bine Brank
|
7d996b1c36
|
dtrmm_utcopy sve function
|
2021-11-13 18:48:53 +01:00 |
|
Bine Brank
|
ab7917910d
|
add v2x8 kernel + fix sve dtrmm
|
2021-11-07 20:37:51 +01:00 |
|
Bine Brank
|
7093372e32
|
add ARMV8SVE target
|
2021-11-01 22:53:21 +01:00 |
|
Bine Brank
|
a8fbdbac34
|
fix sve dgemm kernel + sve dtrmm
|
2021-10-31 10:24:25 +01:00 |
|
Bine Brank
|
746b4f0f17
|
added SVE ncopy and tcopy
|
2021-10-30 12:11:44 +02:00 |
|
Bine Brank
|
1a10d3e09d
|
add sve dgemm prototype
|
2021-10-27 16:37:18 +02:00 |
|
Martin Kroeker
|
22bf5c27ba
|
Add basic support for the Fujitsu A64FX (#3415)
* Add initial support for Fujitsu A64FX as generic ARMV8
|
2021-10-18 15:00:19 +02:00 |
Wangyang Guo
|
63a103ba6e
|
sbgemm: spr: disable small matrix path by default
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
82194ea9d2
|
sbgemm: spr: implement otcopy_16
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
8632380a96
|
sbgemm: spr: reuse ncopy_16 from cooperlake as incopy
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
6bc8204ce5
|
sbgemm: spr: optimization for tmp_c buffer
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
f018aa342a
|
sbgemm: spr: kernel handle alpha != 1.0
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
a52456b168
|
sbgemm: spr: oncopy: use tile load/store instead
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
f2485352a6
|
sbgemm: spr: only load A once in tail_k handling
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
9ab33228bb
|
sbgemm: spr: process k2 and odd k at the same time
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
10d52646e2
|
sbgemm: spr: oncopy: avoid handling too much pointer at a time
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
88154ed02d
|
sbgemm: spr: reduce tile conf loading by seperate tail k handling
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
a70bfb52d5
|
sbgemm: spr: kernel works for NN case when alpha is 1.0
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
6051c86741
|
sbgemm: spr: kernel works for m32 in NN case
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
d0b253ac6e
|
sbgemm: spr: implement oncopy_16
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
1d48b7cb16
|
sbgemm: spr: add dummy source files
|
2021-10-17 19:08:03 -07:00 |
|
Wangyang Guo
|
3dc6052c7e
|
initial support for Sapphire Rapids platform
|
2021-10-12 01:30:40 -07:00 |
|
Martin Kroeker
|
8c20ca345a
|
Use Neoverse's current mix of ThunderX2 kernels for Vortex as well
|
2021-10-06 11:06:43 +02:00 |
|
Martin Kroeker
|
8e4c209002
|
Merge pull request #3398 from kavanabhat/aix_p10_gnuas
Big Endian Changes for Power10 kernels
|
2021-10-05 18:59:47 +02:00 |
kavanabhat
|
9cc95e5657
|
AIX changes for P10 with GNU Compiler
|
2021-10-01 05:18:35 -05:00 |
|
kavanabhat
|
fe3c778c51
|
AIX changes for P10 with GNU Compiler
|
2021-09-30 06:06:27 -05:00 |
|
Wangyang Guo
|
ee5ca8a328
|
x86_64: BFLOAT16: fix build warning
|
2021-09-28 18:30:06 +08:00 |
|
Martin Kroeker
|
90cc944625
|
Move alphaI to x22 to leave x18 unused (reserved on OSX)
|
2021-09-17 09:53:18 +02:00 |
|
Martin Kroeker
|
590fbff06e
|
move alpha to x19/x20 to leave x18 unused for OSX
|
2021-09-17 09:42:17 +02:00 |
|
Martin Kroeker
|
380940271b
|
Move temp to x21 to leave x18 unused (reserved on OSX)
|
2021-09-17 09:28:19 +02:00 |
|
Martin Kroeker
|
7d75177446
|
Move temp to x21 to leave x18 unused (reserved on OSX)
|
2021-09-17 09:24:11 +02:00 |
|
Martin Kroeker
|
0a4ac4b585
|
Use x21 for I to leave x18 unused (reserved on OSX)
|
2021-09-17 09:19:51 +02:00 |
|
Martin Kroeker
|
7d4a221579
|
Remove unused TEMP2 and reshuffle to leave x18 unused (reserved on OSX)
|
2021-09-17 09:18:25 +02:00 |
|
Martin Kroeker
|
d3a9c7ef7f
|
Merge pull request #3382 from rafaelcfsousa/rafael/cwarnings
[POWER] Remove unused variable warnings.
|
2021-09-17 09:15:16 +02:00 |
|
Martin Kroeker
|
8dfa61a61c
|
Initialize abs_mask1 with itself to silence a gcc warning
|
2021-09-15 22:11:35 +02:00 |
|
Martin Kroeker
|
99aa10b3ff
|
Initialize abs_mask1 with itself to silence a gcc warning
actual initialization is via the _mm_cmpeq_ep18, which I've seen claimed to be the fastest way to set an xmm register to all 1s
|
2021-09-15 22:10:43 +02:00 |
|
Rafael Cardoso Fernandes Sousa
|
b751edf624
|
Fix unused variable warnings on Power
|
2021-09-15 13:36:07 -05:00 |
|
Martin Kroeker
|
80346b8813
|
Merge pull request #3379 from martin-frbg/issue3369-2
Add casts to fix compiler warnings for SkylakeX sasum/dasum
|
2021-09-15 07:18:57 +02:00 |
|
Martin Kroeker
|
ce036a2fc0
|
Add casts
|
2021-09-14 21:41:53 +02:00 |
|
Martin Kroeker
|
ddf106f769
|
Add dedicated entries for BFLOAT16 kernels
|
2021-09-14 16:17:18 +02:00 |
|
Martin Kroeker
|
af8843875a
|
Merge pull request #3376 from martin-frbg/issue3370
Fix a few harmless compiler warnings
|
2021-09-12 00:01:31 +02:00 |
|
Martin Kroeker
|
0925dfe2c9
|
One instance of kernel_4x1 is used even on SKX
|
2021-09-11 15:30:19 +02:00 |
|
Martin Kroeker
|
7d873a329f
|
Add ifdefs around conditionally used functions
|
2021-09-11 14:38:47 +02:00 |
|
Martin Kroeker
|
ef24712030
|
Move a conditionally used variable
|
2021-09-11 14:37:44 +02:00 |
|
Martin Kroeker
|
d17238599b
|
Add casts
|
2021-09-11 13:38:28 +02:00 |
|
Wangyang Guo
|
59a1114d03
|
sbgemm: cooperlake: tuning for small matrix
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
682d66555d
|
sbgemm: cooperlake: implement ncopy_16
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
beccb83b16
|
sbgemm: cooperlake: add n24 kernel for tcopy_4
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
5fcacad32b
|
sbgemm: cooperlake: implement tcopy_4
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
bb1c4fa5bd
|
sbgemm: cooperlake: prefetch A & B
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
7a2d1601ec
|
sbgemm: cooperlake: unroll core loop by 2
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
45fdf951b6
|
sbgemm: cooperlake: reorder ptr increase for performance
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
cece3541ab
|
sbgemm: cooperlake: fix bug in m64n12
|
2021-09-07 21:30:46 +08:00 |
|
Wangyang Guo
|
9df0953cde
|
sbgemm: cooperlake: kernel works for NN
|
2021-09-07 21:30:45 +08:00 |
|
Wangyang Guo
|
2ec9f3a8aa
|
sbgemm: cooperlake: change kernel size to 16x4
|
2021-09-07 21:30:45 +08:00 |
|
Wangyang Guo
|
ef8f5fecc8
|
sbgemm: cooperlake: implement sbgemm_tcopy_32
|
2021-09-07 21:30:45 +08:00 |
|
Wangyang Guo
|
4c294336e6
|
sbgemm: cooperlake: add dummy source files
|
2021-09-07 21:30:45 +08:00 |
|
Martin Kroeker
|
f1e3305974
|
Add workaround for Windows10 macro name clash
|
2021-09-01 21:36:50 +02:00 |
|
Wangyang Guo
|
619588fbab
|
sbgemm: remove unnecessary b0 files
|
2021-08-30 17:55:01 +08:00 |
|
Wangyang Guo
|
f39301935c
|
sbgemm: cooperlake: make sure hot buffer aligned to 64
|
2021-08-30 17:40:30 +08:00 |
|
Wangyang Guo
|
7d27b182fc
|
sbgemm: cooperlake: enable SBGEMM by small matrix path
|
2021-08-30 17:40:30 +08:00 |
|
Wangyang Guo
|
1d83ca4bca
|
Small Matrix: support BFLOAT16 data type
|
2021-08-30 17:40:20 +08:00 |
|
Martin Kroeker
|
bec9d9f63d
|
Merge pull request #3335 from guowangy/small-matrix-latest
Add GEMM optimization for small matrix and single/double kernel for skylakex
|
2021-08-29 22:33:33 +02:00 |
|
Wangyang Guo
|
dbbb39199f
|
sgemv: skylakex: fix build warning
|
2021-08-25 07:13:00 +00:00 |
|
Wangyang Guo
|
e9acb46431
|
sgemv: skylakex: bug fix for sgemv_t kernel in corner case
|
2021-08-25 07:07:27 +00:00 |
|
Wangyang Guo
|
f9dba63c28
|
Small Matrix: skylakex: remove unnecessary b0 source files
|
2021-08-13 03:28:44 +00:00 |
|
Wangyang Guo
|
989e6bbdd3
|
Small Matrix: reduce generic kernel source files
|
2021-08-13 03:17:38 +00:00 |
|
Martin Kroeker
|
04255be948
|
Merge pull request #3344 from gxw-loongson/develop
Delete the macro instruction "li" and use "li.d" instead
|
2021-08-12 15:16:46 +02:00 |
gxw
|
a7bc8ec1f1
|
Delete the macro instruction "li" and use "li.d" instead
Change-Id: Icff7981e2eb7df29ba5af1f8eb5be8443c67450f
|
2021-08-12 17:02:54 +08:00 |
Rajalakshmi Srinivasaraghavan
|
b06880c2cd
|
POWER10: Improving dasum performance
Unrolling a loop in dasum micro code to help in improving
POWER10 performance.
|
2021-08-10 22:06:04 -05:00 |
|
Wangyang Guo
|
44d0032f3b
|
Small Matrix: skylakex: fix build error in old compiler
|
2021-08-05 04:43:47 +00:00 |