[plaso] Added Ubuntu end-to-end tests run script for Jenkins

[plaso] Added Ubuntu end-to-end tests run script for Jenkins

[Joachim Metz, 2018-03-31 10:05:16]

Code updated.

[onager, 2018-03-31 10:53:31]

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
File config/jenkins/linux/run_end_to_end_tests.sh (right):

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
config/jenkins/linux/run_end_to_end_tests.sh:11: LOGGING_OPTIONS="--debug
--log-file=${RESULTS_DIRECTORY}/log2timeline.log.gz";
Please remove, these need to be set in the test configuration

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
config/jenkins/linux/run_end_to_end_tests.sh:18: # Remove old profiling options
set in the configuration.
Please remove, these need to be set in the test configuration

[Joachim Metz, 2018-03-31 10:57:17]

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
File config/jenkins/linux/run_end_to_end_tests.sh (right):

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
config/jenkins/linux/run_end_to_end_tests.sh:11: LOGGING_OPTIONS="--debug
--log-file=${RESULTS_DIRECTORY}/log2timeline.log.gz";
this way you don't need to keep updating the configs and we could levels of
output with the same configs. Largely that the configs need to be manually
edited at the moment.

https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
config/jenkins/linux/run_end_to_end_tests.sh:18: # Remove old profiling options
set in the configuration.
On 2018/03/31 10:53:31, onager wrote:
> Please remove, these need to be set in the test configuration

see previous comment

[justzamir, 2018-03-31 11:05:35]

On 2018/03/31 10:57:17, Joachim Metz wrote:
>
https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
> File config/jenkins/linux/run_end_to_end_tests.sh (right):
> 
>
https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
> config/jenkins/linux/run_end_to_end_tests.sh:11: LOGGING_OPTIONS="--debug
> --log-file=${RESULTS_DIRECTORY}/log2timeline.log.gz";
> this way you don't need to keep updating the configs and we could levels of
> output with the same configs. Largely that the configs need to be manually
> edited at the moment.
> 
>
https://codereview.appspot.com/339480043/diff/20001/config/jenkins/linux/run_...
> config/jenkins/linux/run_end_to_end_tests.sh:18: # Remove old profiling
options
> set in the configuration.
> On 2018/03/31 10:53:31, onager wrote:
> > Please remove, these need to be set in the test configuration
> 
> see previous comment

https://dragshare.co/gb-instagram-apk-download/

[Joachim Metz, 2018-04-02 07:27:01]

What about having the configs (at the greendale ones) checked into git as well ?

This way it will be easier to keep them up to date

[Joachim Metz, 2018-04-02 07:52:44]

Code updated.

[Joachim Metz, 2018-04-02 07:56:45]

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
File config/jenkins/greendale/dean.ini (right):

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
config/jenkins/greendale/dean.ini:1: [dean]
I opt we check in the greendale configs to keep them up to date easier.

[Joachim Metz, 2018-04-02 10:46:23]

Code updated.

[Joachim Metz, 2018-04-02 10:54:36]

Code updated.

[Joachim Metz, 2018-04-02 16:06:28]

Code updated.

[Joachim Metz, 2018-04-06 04:53:40]

Code updated.

[onager, 2018-04-07 13:27:00]

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
File config/jenkins/greendale/dean.ini (right):

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
config/jenkins/greendale/dean.ini:1: [dean]
On 2018/04/02 07:56:45, Joachim Metz wrote:
> I opt we check in the greendale configs to keep them up to date easier.

Yes, this in my backlog. I've been focused on getting the tests running and
producing data for the moment, though.

[Joachim Metz, 2018-04-07 15:53:53]

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
File config/jenkins/greendale/dean.ini (right):

https://codereview.appspot.com/339480043/diff/40001/config/jenkins/greendale/...
config/jenkins/greendale/dean.ini:1: [dean]
Then I'll add the rest of the configs in this CL.

[Joachim Metz, 2018-04-07 17:21:26]

Code updated.

[Joachim Metz, 2018-04-19 13:52:07]

Code updated.

[Joachim Metz, 2018-04-20 07:44:34]

Code updated.

[Joachim Metz, 2018-05-05 09:01:05]

Code updated.

[onager, 2018-05-06 09:39:58]

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/greendale...
File config/jenkins/greendale/acserver.ini (right):

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/greendale...
config/jenkins/greendale/acserver.ini:8:
profiling_options=--profilers=memory,parsers,processing,serializers,storage,task_queue
--profiling_directory=plaso_out/profiling
Please put the the profiling files in "plaso-out", for consistency with existing
tests.

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
File config/jenkins/linux/run_end_to_end_tests.sh (right):

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:15: RESULTS_DIRECTORY="plaso_out";
Please keep this as "plaso-out" for consistency with existing tests.

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:42: echo "End-to-end tests stared
(PID: ${PID_COMMAND})";
started

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:48: # On Travis-Ci print the stdout
and stderr output to troubleshoot potential issues.
CI

[Joachim Metz, 2018-05-07 05:36:00]

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/greendale...
File config/jenkins/greendale/acserver.ini (right):

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/greendale...
config/jenkins/greendale/acserver.ini:8:
profiling_options=--profilers=memory,parsers,processing,serializers,storage,task_queue
--profiling_directory=plaso_out/profiling
please document this in l2tdocs or equiv, including the conventions used.

https://github.com/log2timeline/plaso/issues/1873

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
File config/jenkins/linux/run_end_to_end_tests.sh (right):

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:15: RESULTS_DIRECTORY="plaso_out";
Please document conventions used in jenkins configurations

https://github.com/log2timeline/plaso/issues/1873

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:42: echo "End-to-end tests stared
(PID: ${PID_COMMAND})";
On 2018/05/06 09:39:58, onager wrote:
> started

Done.

https://codereview.appspot.com/339480043/diff/200001/config/jenkins/linux/run...
config/jenkins/linux/run_end_to_end_tests.sh:48: # On Travis-Ci print the stdout
and stderr output to troubleshoot potential issues.
On 2018/05/06 09:39:58, onager wrote:
> CI

Done.

[Joachim Metz, 2018-05-07 05:40:46]

Code updated.

[onager, 2018-05-10 08:16:06]

LGTM

[Joachim Metz, 2018-05-10 09:09:54]

Changes have been merged with master branch. To close the review and clean up
the feature branch you can run: review.py close jenkins