On Fri, Aug 9, 2019 at 2:16 PM Carnë Draug <

[hidden email]> wrote:

>

> On Fri, 9 Aug 2019 at 05:30, Rik <

[hidden email]> wrote:

> > I wanted to look to look empirically at the slow down that has occurred

> > over time with Octave.

> >

> > [...]

> >

> > Any ideas?

>

> Have we actually established that Octave has indeed been running

> slower over time? There's been a lot of talk about it, but all the

> measurements I have seen where by running the test suite and not a

> real Octave program.

>

> I think that before worrying about what tools to check where the

> performance drop is, maybe we should get a set of programs that can be

> used to confirm this slowdown.

>

> For what is worth, I too have the feeling that Octave has been getting

> slower over time, I just haven't actually got around to confirm this

> with proper methods.

>

I run somewhat modified sciviews' benchmark (size of test matrices

increased) and

I do not see much difference in the last few years:

octave-4.2.0-rc2 (2016-09-21):

Octave Benchmark 2

==================

Number of times each test is run__________________________: 3

I. Matrix calculation

---------------------

Creation, transp., deformation of a 5000x5000 matrix (sec): 1.1713

5000x5000 normal distributed random matrix ^1001____ (sec): 1.9489

Sorting of 9,000,000 random values__________________ (sec): 1.0415

5000x5000 cross-product matrix (b = a' * a)_________ (sec): 2.7143

Linear regression over 5000x5000 matrix (c = a \\ b') (sec): 2.1651

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 1.7034

II. Matrix functions

--------------------

FFT over 9,000,001 random values____________________ (sec): 0.80781

Eigenvalues of a 900x900 random matrix ______________ (sec): 2.4541

Determinant of a 5000x5000 random matrix____________ (sec): 1.2405

Cholesky decomposition of a 5000x5000 matrix________ (sec): 0.5662

Inverse of a 5000x5000 random matrix________________ (sec): 3.9265

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 1.3498

III. Programmation

------------------

9,500,000 Fibonacci numbers calculation (vector calc)_ (sec): 1.5602

Creation of a 5250x5250 Hilbert matrix (matrix calc) (sec): 0.48573

Grand common divisors of 500,000 pairs (recursion)___ (sec): 0.17606

Creation of a 620x620 Toeplitz matrix (loops)_______ (sec): 5.363

Escoufier's method on a 97x97 matrix (mixed)________ (sec): 5.8139

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 1.5959

Total time for all 15 tests_________________________ (sec): 31.4351

Overall mean (sum of I, II and III trimmed means/3)_ (sec): 1.5424

--- End of test ---

Today's (2019-08-09) dev (hgid = 2c4759c8239c @)

Octave Benchmark 2

==================

Number of times each test is run__________________________: 3

I. Matrix calculation

---------------------

Creation, transp., deformation of a 5000x5000 matrix (sec): 1.1394

5000x5000 normal distributed random matrix ^1001____ (sec): 0.93096

Sorting of 9,000,000 random values__________________ (sec): 1.0292

5000x5000 cross-product matrix (b = a' * a)_________ (sec): 1.4269

Linear regression over 5000x5000 matrix (c = a \\ b') (sec): 1.2995

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 1.1508

II. Matrix functions

--------------------

FFT over 9,000,001 random values____________________ (sec): 0.81812

Eigenvalues of a 900x900 random matrix ______________ (sec): 0.64627

Determinant of a 5000x5000 random matrix____________ (sec): 1.3008

Cholesky decomposition of a 5000x5000 matrix________ (sec): 0.57645

Inverse of a 5000x5000 random matrix________________ (sec): 3.7264

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 0.8827

III. Programmation

------------------

9,500,000 Fibonacci numbers calculation (vector calc)_ (sec): 0.86849

Creation of a 5250x5250 Hilbert matrix (matrix calc) (sec): 0.52379

Grand common divisors of 500,000 pairs (recursion)___ (sec): 0.16265

Creation of a 620x620 Toeplitz matrix (loops)_______ (sec): 4.4124

Escoufier's method on a 97x97 matrix (mixed)________ (sec): 5.966

------------------------------------------------------

Trimmed geom. mean (2 extremes eliminated): 1.2614

Total time for all 15 tests_________________________ (sec): 24.8273

Overall mean (sum of I, II and III trimmed means/3)_ (sec): 1.0861

--- End of test ---

This is on i7-2600 computer.

Dmitri.

--