Development Builds

Re: Development Builds

Postby Josef Templ » Wed Nov 30, 2016 8:59 pm

Robert wrote:I have written a BlackBox module that takes the "Dates.txt" file (see my previous post), and corrects all the file date stamps in a given version of BlackBox (eg build #741) to reflect when that file was last modified. See below:

There is probably a 1 line Unix command that does this!

The Docu file (in the pac coding below) gives detailed instructions to do all this.

I would like this "FileDates.txt" file to be routinely produced by the build engine (if this is possible), and made available, maybe in the same place as the "buildlog.html" file.


What is this information used for?

- Josef
User avatar
Josef Templ
 
Posts: 2002
Joined: Tue Sep 17, 2013 6:50 am

Re: Development Builds

Postby Robert » Thu Apr 13, 2017 7:48 pm

Josef Templ wrote:What is this information used for?

I have given this some thought - for four months!
When I switch to a new version, which I did today, I want to update (hack!) a few Menu, Strings (& a very few Mod) files. This involves copying across my changes, but also checking if there have been any official changes since the last time I changed them. This is easier if the file dates are informative (correct).

It is unnecessary to have correct dates, and it is only a small convenience.
But, logic aside, I definately much prefer to have the file dates correct.

I am up against a hard deadline at work. I wanted to progress forward from 1.7 stable, but can't wait for a new stable, so build 845 is going to be my reference build for the next period of time. If we could move to a stable build compatible with 845 I will be in a position to republish on CPC most of the material I needed to withdraw a year ago.
User avatar
Robert
 
Posts: 987
Joined: Sat Sep 28, 2013 11:04 am
Location: Edinburgh, Scotland

Re: Development Builds

Postby Zinn » Mon Apr 17, 2017 6:02 am

Robert wrote:
Josef Templ wrote:What is this information used for?

I have given this some thought - for four months!
When I switch to a new version, which I did today, I want to update (hack!) a few Menu, Strings (& a very few Mod) files. This involves copying across my changes, but also checking if there have been any official changes since the last time I changed them. This is easier if the file dates are informative (correct).

It is unnecessary to have correct dates, and it is only a small convenience.
But, logic aside, I definately much prefer to have the file dates correct.


Sorry Robert, to have a correct file date is a Microsoft Windows problem. Today when you expand a zip file the file get the expanded date. In older Windows version you get the original file date. When you copy files from NTFS to FAT the date may change depending if you have summertime or wintertime (daylight time or not). Every new Windows is getting more worse and old rules are no longer valid.

I use my own BlackBox program to find differences between two BlackBox version.
- Helmut
Zinn
 
Posts: 470
Joined: Tue Mar 25, 2014 5:56 pm
Location: Frankfurt am Main

Re: Development Builds

Postby Robert » Mon Apr 17, 2017 8:59 am

Zinn wrote:Sorry Robert, to have a correct file date is a Microsoft Windows problem. Today when you expand a zip file the file get the expanded date. In older Windows version you get the original file date. When you copy files from NTFS to FAT the date may change depending if you have summertime or wintertime (daylight time or not). Every new Windows is getting more worse and old rules are no longer valid.

You make two interesting points I was unaware of:

1 - I have recently had some unexplained problems with file times moving by 1 hour (in one case this changed the date). This is the first spring time-change since I moved from XP. I often copy files between computer systems on a FAT USB stick. Maybe there is a pattern here?

2 - Regarding Center BlackBox builds. Are you suggesting the files go into the Zip with the correct time-stamp, but come out with the incorrect one (ie the un-zip date)? Is there a sinple solution, such as using a different zip program (I think I used to use "Zip-7" or some similar name). If I used the "setup.exe" rather than the ".zip" would I get the correct file dates? If zip and modern Windows are incompatible maybe we should stop using zip, and use pac instead!

3 - Nothing to do with BlackBox. Where I find date stamp corruption a real nuisance is my collection of 100 000+ map "tile" files which I want to keep aligned with my PC program (BlackBox) and my portable Android program. Windows might change every few years, but Android and the Apps required to go with it seem to change (for the worse) every 5 minutes. This is this week's preoccupation as I am planning next week's motorcycle tour to Southern Spain.
User avatar
Robert
 
Posts: 987
Joined: Sat Sep 28, 2013 11:04 am
Location: Edinburgh, Scotland

Re: Development Builds

Postby DGDanforth » Mon Apr 17, 2017 10:51 am

Robert wrote: I am planning next week's motorcycle tour to Southern Spain.

Please be very careful! Motorcyles can be dangerous.
User avatar
DGDanforth
 
Posts: 1061
Joined: Tue Sep 17, 2013 1:16 am
Location: Palo Alto, California, USA

Re: Development Builds

Postby Josef Templ » Mon Apr 17, 2017 1:40 pm

Robert wrote:
Zinn wrote:Sorry Robert, to have a correct file date is a Microsoft Windows problem. Today when you expand a zip file the file get the expanded date. In older Windows version you get the original file date. When you copy files from NTFS to FAT the date may change depending if you have summertime or wintertime (daylight time or not). Every new Windows is getting more worse and old rules are no longer valid.

You make two interesting points I was unaware of:

1 - I have recently had some unexplained problems with file times moving by 1 hour (in one case this changed the date). This is the first spring time-change since I moved from XP. I often copy files between computer systems on a FAT USB stick. Maybe there is a pattern here?

2 - Regarding Center BlackBox builds. Are you suggesting the files go into the Zip with the correct time-stamp, but come out with the incorrect one (ie the un-zip date)? Is there a sinple solution, such as using a different zip program (I think I used to use "Zip-7" or some similar name). If I used the "setup.exe" rather than the ".zip" would I get the correct file dates? If zip and modern Windows are incompatible maybe we should stop using zip, and use pac instead!

3 - Nothing to do with BlackBox. Where I find date stamp corruption a real nuisance is my collection of 100 000+ map "tile" files which I want to keep aligned with my PC program (BlackBox) and my portable Android program. Windows might change every few years, but Android and the Apps required to go with it seem to change (for the worse) every 5 minutes. This is this week's preoccupation as I am planning next week's motorcycle tour to Southern Spain.


Interesting, in my zip/unzip experiments under both Vista and Win10 I get the original file dates, as expected.
May be there is an option in the zip file format/tool that affects the behavior.
If there is a way to reconstruct the file dates reliably from the commit info in git, it could be included in the build engine.
Just let me know the command or tool required. Look for the timezone. Is it UTC or local time that is required?

- Josef
User avatar
Josef Templ
 
Posts: 2002
Joined: Tue Sep 17, 2013 6:50 am

Re: Development Builds

Postby Robert » Mon Apr 17, 2017 2:24 pm

Josef Templ wrote:If there is a way to reconstruct the file dates reliably from the commit info in git, it could be included in the build engine.
Yes, I believe there is a way. It returns local time & UTC offset. Note that we are a widely spread community, so the UTC offsets vary considerably on a file-by-file basis.
While I think this process is reliable, I would not describe it as convenient, so having it automated would be good.
An example GIT output is:
Code: Select all
      2014-09-09 00:01:33 +0800 .gitignore
      2014-09-09 00:01:33 +0800 BlackBox.exe.manifest
   …
      2016-11-27 23:32:02 +0700 Dev/Mod/Browser.odc
   …
      2016-10-06 15:07:07 +0700 appbuild/AppVersion.txt
      2014-09-09 14:34:01 +0200 appbuild/appendProps.txt
      2016-09-13 11:50:27 +0200 appbuild/build.py
      2016-11-25 00:32:31 +0700 appbuild/newbbscript.txt

I have carefully documented the method for getting this output (based on Ivan's suggestions) in the Docu for my tool that uses it to update the files.
Code: Select all
PacCoder.Decode /./rLtBB8Y.1GlhwNK8PXcskx..bXUw1Sk3W7gFTl4S79lCk/qsgHo824cfo
68XRe:b6tnF/ZKsRrE7ZSs2xlKvW1r38KXE7BlgvXDr1d.gqCfc8W5QI3ZXK6RMsmwlJf/Q5:6aE
Fjm/4g801zp5Tk8CSD26LD4Vj16FcrVjtj2qJo:DS48/i1wFp5.jcQLS.sduEz8.i1RLkIHGb6af
VL2i7T6n:Lv2SToQcwDFvh:f5PbEX2CMCHL:MbcqMDEbd/m7S.u:Kf1X4jjcmuGTCvIQRbHQx321
xu75:m2R0K77ICg8VjwwcOcswSIF4OvVFo4IH5aCWGUzBEoHJr1f7ewWDvNICq6DUmWIluN4dIF.
Bx/KTTCaCIpj7:Qf1UjvFWDzq/oxVZ:6MH04:kVd:6KaU5kVmwR/xiByFTbY:lx7t0gTt1VB.joj
CoBvzEebpUNzcDjUyzOGeP2sV2Zs6FcELkOJl4D9cEzX/hzcIRc3o9IdcJBFzzhsaaTe/uL:0yiV
UXmXEn1oHEgvHJDn3DeZrys4tUP0Mjqd5nja65mPkBJFj.rlXl:cHggRyFLhZGNVigdSzlfa:s7f
F:XT:TINfVd:ivy6eaG56ooK1maGHtrvrsWri4xh7ozdelaDrkEvFxGCrPP3xxdZ6yzRBzCvnbSF
Sfl6D5y:y6SS71CkiNiSJrBjYNuPfwwYlsXQwEvabmKaOgkaOvxc7ixXMH:ZRmNcj1QqVONTyK:q
uy:4It:nXKaBmosK7o8lRWyP4ftjaxjLLmnNTC/iVuv:SXEiyOLuf4rzwlMRsuvtlrN/KhpwfL9t
B9a7QdqiPtPDR2o6TbjJhwtDe.cCuCddwxJTgjYgdfzshSqnQNbiyR1rFvr20b5dHpiatzRT6Hgg
hRt9hBzPXN4HeDRIQJrFwsbhFdh/kZvQ4MZedIIqW:Lnfy9OzM54DJ5xB8l5W7vtrtipS:uoEyZ:
JCyc39Gdp0yRZLR0:b0slscLzE946mtIfixTMr4/CP.DBg4b6WkW4Q0hQb:KlTuCtLRwv7skTlsP
CHqi4QbUZEv7h9YWhq6FFNratDU:7okfo9t1ZrKpC4:xLaOyBb:74t7xWdzyr7LRuds6Hmoj7unw
iWj:BFu40OnYanCHxisRB3xm4ihF1iHvS0CBXcYGT4stBgvaG8ua02Ctst:RrV1JjKXYjCaJ0TFU
PowNhFUDdhN9LTpSz1Txq9ukZeCGnhvSPaKymonmnZ/IuN9KqnYzbcW9JffHI83DP:nVT4OTH1OU
Gn/ynjzNnXi.m3sY7EgGuEm1Cyo1pf/:B/VB6E9tjEN3zvz5jX2bODTtzjqV1:kcjuIVshCB1cfu
7wd3EzNMYLwyJqyV.RXjmUXj5Qszw3upfzz6hbcbDNxa5NaRzoGT3uSx.8HC71kKI82BgZWHRSHJ
qCyirbT55S6Bn:lbaE2Ss1sCBuyo5f4WLlyjzltILWJxcNz3xaLSMmzhxZnzP3c5WSEt5CjgxExt
PjSvEhboujH0dFHNuGrZN8B5Hx/HfV93Z.vya.SvRxiqxpTclfyp9nfngRkeS2aFw5TWdgwnHuPJ
q09fqYFizxsBTuzlwpK4/Cqq4uBj6CewVRIFcTkcr:DzphbF9jRr5ngF9JQNPhotNLw08xYQJIQ:
tP:1eKWOGJrXixzS:bp7XK5xCv0ZvYTj2Bi2ha5h0CSV1qvSUsm80s89lIHFh0hX6lPQCbfHl2.B
8fjHcpMfWPfjGCKuVRXjfQs3GDQTHHubwFYZ6s69Co3.nIbSSdupR:DT.e5g4J4Cno5X6UTXDwfK
UiIGgTa7vNyFrsIbWYRgJpjqrEmhKF6ZuCghX6unWaazUr6:7ivS:95TCiTs.z1/CHr7dqknz7ms
TrQzJCs0vylLQj1LFjgJqD2nmpiIDHsG7HZrMKowvex5j7McRtUFRrPKc6DwG1qdNhoBXvXgMoYS
O4xRTg7c2Mp7nig5DxvvS/9jS0cPczf:9xv1xLcBEs/Ns8wq4eEpQFCKLTPqODKlyHxLN4nDZEvd
XpPi5POBuYwEPvotHyVRPlSrSjPqpKq0JaHs9vNkxDrF/vuq.TaDN1cCk1rKU2V1Su.LpWDoimC1
9.zHifI1TgIBYIc:TXIbqRCRxiUF2KzgUomNoj3axOJ2vc98VJlHoj7E0EbtYgay0hTfcXwwBnjT
S:ZqES3rpfMzLqJ2jlXsrV9Cx/mshJHRwrMBoFCvuHY7qZPKcrr6zN4wenR/Q0rjHatydu1iUFjj
Dx9vBaP27SqLQMhq9R.w2.YwpgLhy9tTeJeJhTxo1uNsZxdxad5SPOjvrSzG:zLiCY92aokjcW78
FGyoPVDbN9ncNnJJK1xfhgnqk3PYoPDamfvlHVTsIRDNGjCq8YhTWoeHodXlEYiM2DYfbRFvBF4H
IdLmMXnv7ELWRZit5Mohl/IBNF4TCFccaDii7gshBijodDGKLN0hbK10tGawM/N73xaffKSauxpm
pa0VnUbnWioHwk32.gMBlsUEYf6HZmc/0jY0SMSS6MsPuduz27g3kaUe6hYD/u.0Wx/O1MWX:vQl
dXZt9u9rq/RLTVht.NpJKUN5ijsttpKSvobebms0hH3SfaGTR.trB6GQDDa0rxM/j32rYtlvFByj
ujd3QYzbvz6zgRjOv5JULX5DYDg7hqgaeCWz9.d:qqSQhuqg8EvumqnKRM0CpHzQKPvcWCHeC6aD
IsKonoKQbzGiO1u5ft5y7zs1RDqfcrkawbCqRJBqHCFSkbqTNuqtzoULQhBYojYcDitMFTRRX/pF
w9TxBlT1jr1R8zpKKMjE1TaoV0cJzdPgQa8mCaR1YRF4EQ59toXdVythzDsGcGeXuFwtreT7tYmd
aYzaYJSVK0Ngv0N4RiOxtJW9pMbmcvnehXXPSn/mbq.DWdZY4RTqc25WedBZsRH5sVgQDHwmdZuN
nhYeyP9DBjWlrZYlYssFV5EzWCxWYy3ZGaWEcScC9ykjY0blwdlfFfTR3ZhrO5inHGOt5EmMuOj7
5fsk75ntrU5US7IWIibySWmxjsUMdp5hLYXurHZOIKtWnMSJuJ3Gu9BC7.0g5mEZTUz0yr4Jdsbp
5uJEXm98XjT4SbC2T7d0z9X5XSJzo5w4hjx9mIOkHyaX8DwQfVaEzDuelZ1Qsdopt5STiHK:ndPt
8XsnBg:CHIyz/5NZmJR82ookuZlXhrU1:xdtpWYO3woeKv/zsNPzhRewhMacXqjiNruzKuqVlkRJ
j:7IxedQdxH7VrY/qvg5T6NvRCpHWn.qYCxBVbuFvNqeePv7KdNSb1ZfeMrhRrrjrkuyxQz3tcxo
S0LZ:/XZK/htf9LTk2xn1:gzi4fVUsNdieUy4VeHMwNc25VMat/ie:JO59zUfEHiSzM1DXPpsoUc
a8nnq/sr:dna9SJ7r:B02xYmTlkDZRd/YFugeR0FleNIwJVDsrdc2q/hwNVDPDTeUG5Nw7tJ0rlc
ivhIsZPa8qiVHxPWCb55sBIEG3e0HD4IubXB0HtDjSMRLk2RkbdKrCm1xwJoFy9j..t6s5qfzzy.
AtEndOfEncoding
User avatar
Robert
 
Posts: 987
Joined: Sat Sep 28, 2013 11:04 am
Location: Edinburgh, Scotland

Re: Development Builds

Postby Robert » Mon Apr 17, 2017 2:35 pm

Josef Templ wrote:Is it UTC or local time that is required?
Good question.
I use the file described above to create BlackBox UTC Date & Time records, then update the files using
Code: Select all
PROCEDURE  FileSetDateTime (IN fullName : ARRAY OF CHAR;
                            IN date : Dates.Date; IN time : Dates.Time) : BOOLEAN;
  VAR
    fi       :  Api.HANDLE;
    sysTime  :  Api.SYSTEMTIME;
    fiTime   :  Api.FILETIME;
  BEGIN
    sysTime.wYear    :=  SHORT (date.year);
    sysTime.wMonth   :=  SHORT (date.month);
    sysTime.wDay     :=  SHORT (date.day);    sysTime.wDayOfWeek     :=  0;
    sysTime.wHour    :=  SHORT (time.hour);
    sysTime.wMinute  :=  SHORT (time.minute);
    sysTime.wSecond  :=  SHORT (time.second); sysTime.wMilliseconds  :=  0;
    ASSERT (Api.SystemTimeToFileTime (sysTime, fiTime) # Api.FALSE, 20);
    fi  :=  Api.CreateFileW (fullName, Api.FILE_WRITE_ATTRIBUTES,
                             Api.FILE_SHARE_WRITE, NIL, Api.OPEN_EXISTING, {}, 0);
    RETURN  (Api.SetFileTime (fi, NIL, NIL, fiTime) # Api.FALSE)
         &  (Api.CloseHandle (fi) # Api.FALSE)
  END  FileSetDateTime;

I think this worked correctly when I wrote it a few months ago, but then my local time (GMT) was the same as UTC; maybe this code is not correct, for me, today?
The Microsoft page for the FILETIME structure says
Therefore, the GetFileTime function may not return the same file time information set using the SetFileTime function. Furthermore, FAT records times on disk in local time. However, NTFS records times on disk in UTC.
so the process of going from the Git output to actually correcting the files is not something I find simple.
User avatar
Robert
 
Posts: 987
Joined: Sat Sep 28, 2013 11:04 am
Location: Edinburgh, Scotland

Re: Development Builds

Postby Robert » Tue Jul 04, 2017 10:44 am

If you look at http://blackboxframework.org/unstable/ there are four sub-directories related to issues; two of these issues are open and two are closed.

What is the process for deleting these sub-directories for closed issues?
User avatar
Robert
 
Posts: 987
Joined: Sat Sep 28, 2013 11:04 am
Location: Edinburgh, Scotland

Re: Development Builds

Postby Josef Templ » Tue Jul 04, 2017 12:22 pm

Robert wrote:If you look at http://blackboxframework.org/unstable/ there are four sub-directories related to issues; two of these issues are open and two are closed.

What is the process for deleting these sub-directories for closed issues?


Currently, there is no process about deleting closed issues from the unstable dir.
I delete them manually from time to time.

It may be possible to delete them automatically but I don't know how to detect this event.

- Josef
User avatar
Josef Templ
 
Posts: 2002
Joined: Tue Sep 17, 2013 6:50 am

Previous

Return to Infrastructure

Who is online

Users browsing this forum: No registered users and 1 guest