<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hi Mario,</p>
<p>In the days of pd-extended some template patches were created
that compared generated data with a reference data set. <br>
</p>
<p>See
<a class="moz-txt-link-freetext" href="https://git.puredata.info/cgit/svn2git/libraries/testtools.git/">https://git.puredata.info/cgit/svn2git/libraries/testtools.git/</a>.</p>
<p>Greetings,</p>
<p>Fred Jan<br>
</p>
<div class="moz-cite-prefix">On 10/06/2020 12.45, Mario Buoninfante
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAHs=M8TFMgz4bxfOfgck_=mU5D0E+Y2FZgL+J3BBq=8YZ3fJzQ@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div>Hi all, <br>
</div>
<div><br>
</div>
<div>Like I mentioned a couple of days ago, I'm currently
working on a simple test suite for Pd, hoping this could be
useful when working on new features/releases.</div>
<div>The idea is to have a high level test suite that doesn't
test the source code but instead runs Pd, then launches the
tests and gathers results.</div>
<div>Of course this approach, like everything, has its pros and
cons.<br>
</div>
<div>I suppose in the pros list we have:</div>
<div>- easy to setup and run<br>
</div>
<div>- not testing single "units", but "units" in a bigger
context<br>
</div>
<div>- easy to maintain/populate<br>
</div>
<div><br>
</div>
<div>In terms of cons:</div>
<div>- reports are quite generic - we know where it fails but
then some investigation is needed<br>
</div>
<div>- not testing single units means something small broken can
affect a lot of tests (I suppose that's a good thing also)<br>
</div>
<div><br>
</div>
<div>I'm sure there are more pros and cons.<br>
</div>
<div><br>
</div>
<div>I am keeping the thing as simple as possible in the hope
that anybody can populate the test pool, run the suite and
look at the results.</div>
<div><br>
</div>
<div>Ideally at some point the suite will have a test for each
Vanilla object and also a test for each bug fix.<br>
</div>
<div><br>
</div>
<div>I'm at a point where I'd like to get some feedback before
going ahead (ie "this is pointless!!!!!", "I won't bother
using it", "I'd rather do it this other way...", "I think it's
ok", etc.),. <br>
</div>
<div>I got something basic up and running (tested on Ubuntu
Studio 20.04 and MacOS High Sierra 10.13.6 only for now) that
can be found here:</div>
<div><br>
</div>
<div><a href="https://github.com/mariobuoninfante/pdtest/"
moz-do-not-send="true">https://github.com/mariobuoninfante/pdtest/</a></div>
<div><br>
</div>
<div>Please if you have any time at all, give it a try and share
your thoughts (currently doesn't work on Windows simply cause
I didn't have any Win machine on hand, but it should be pretty
easy to make it run there as well).<br>
</div>
<div><br>
</div>
<div>Cheers,</div>
<div>Mario<br>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
<a class="moz-txt-link-abbreviated" href="mailto:Pd-list@lists.iem.at">Pd-list@lists.iem.at</a> mailing list
UNSUBSCRIBE and account-management -> <a class="moz-txt-link-freetext" href="https://lists.puredata.info/listinfo/pd-list">https://lists.puredata.info/listinfo/pd-list</a>
</pre>
</blockquote>
</body>
</html>