Latest Cardservproxy Trunk Versions

Status
Not open for further replies.

juli13

Staff member
Administrator
Messages
10,194
20.03.2010

Cardservproxy 0.9.0 - RC6


Code:
[B]0.9.0 - RC6[/B]

- Fixed: The included ConaxConnector plugin in 0.8.13 was an older version.
- Fixed: Extra http auth login was required for accessing plugin webs (bug introduced in 0.8.13).
- Fixed: Probing of connectors with unknown status wasn't done when cache hits occured.
- Fixed: No longer possible to create multiple profiles where both ca-id and network-id are the same.
- Fixed: Anonymized (non-au) newcamd card-data can no longer end up with user id 1 (this confused some clients).
- Fixed: Disabling a profile now automatically disables any connectors that explicitly references it.
- Fixed: Enigma services file parsing now uses comma separated filter strings, to allow names with spaces.
- Changed: Network-id is now used in enigma services file parsing only when no provider string filter is set.
- Changed: All time fields in the config can now be specified in minutes/secs/millisecs by adding a suffix (m, s, ms).
  If no suffix is added, the old default for the field will be assumed (so configs/docs remain compatible).
- Changed: Added and updated defaults in the generated proxy.xml template to make more sense with the current version.
- Changed: ClusteredCache sync-period is now used even in receive-only mode (without peers). This can allow you to
  significantly increase cache hits at the expense of ecm transaction time. ClusteredCache is now used by default.
- Added: Services parser for dvbviewer exports (ini files). The filter string is matched against the "Root" key if set.
- Added: Timed ecm blacklist per connector, to avoid forwarding the same ecm several times to a connector that can't
  handle it (mainly when there is no sid to go by in the request). Entries will be kept for 3*max-cw-wait.
- Added: Slightly better awareness of satellite concepts like provider-idents and other ca-system-specific artefacts.
  This includes extending the service mapper with an additional custom-id/cid (besides sid) for systems like irdeto.
  For some systems this will include provider-ident as a factor in the mapping (with require-provider-match for profile).
- Changed: Max-connections changed to a per-profile value, to handle the satellite scenario of the same user connecting
  to multiple profiles. I.e now max-connections 1 means the user is allowed 1 connection in every profile they have.
  NOTE: This means if you change the value or add ports to a profile, you may have to kick users before it takes effect.

- Added: New connector type 'csp-connector' specifically for chaining multiple proxies together. Requires that the
  ONID (network-id) and ca-id is set properly for all profiles in all involved proxies. This type allows multiple
  profiles to be shared over a single connection, and prevents loops (forwarding the same ecm back and forth between
  proxies that have each other as connectors). 
  The protocol is documented in the source and connections are initiated using the httpd (so ssl can/should be used).
  See proxy-reference.html for more info.
- Added: New connector type 'chameleon-connector' for connecting to newcs as mgcamd and accessing multiple cards in one
  newcamd session. Only properly identified traffic can be sent to this connector type (known caid + provider ident).
  Only remote cards that map into locally defined profiles (matching caid/provider ident) will be used.
- Added: Support for mgcamd/newcs newcamd-extensions in incoming connections (via a single extended-port for all
  profiles), using multiple systems over a single newcamd session. For this to work all combinations of caid and
  provider ident must map to a profile with network-id set. Ambiguous traffic will be denied.
- Added: Redundant forwarding. The service mappers can now be configured to select two of the least loaded connectors
  instead of just one (if two or more candidate connectors exist for a request). If enabled, this can up to double the
  load on the cards, but assuming enough capacity exists it will mean always having a backup ready in case the primary
  connector choice failed/timed out for any reason. Should improve reliability in single-node proxy setups.
- Added: Plugin dependency resolver. This makes it easy to build plugins that make use of existing 3rd party libraries,
  by fetching jars automatically on first load. See README.Plugins.txt for more info and DreamboxPlugin for examples.
- Added: getProperties() method in the plugin interface, for returning arbitrary usage information shown in the output
  of the proxy-plugins status command.

- Added: When using only asynchronous connectors, it is now possible for a client session to get a cache hit even after
  a forward to card was initiated. This can result in transactions with both F and C/R flags.
- Added: Last-seen data now also contains entries for failed login/connect attempts, available through a new status
  command 'login-failures' (available to all users, but non-admins can only see attempts made with their user name).
- Added: New interface ReplyFilter that plugins can use to intercept and alter/block DCW's as they're returned from
  connectors, before they're processed by the proxy (possibly find and delete bad CW's). See README.Plugins.txt.
  A DcwFilterPlugin that illustrates this and blocks some common bad responses is included.
- Added: Fixes for running under jamvm on embedded systems (including the broken auto-generating of the config template).
- Added: New status commands for troubleshooting: 'export-services', 'system-properties', 'system-threads' and
  'proxy-plugins'.
- Added: Option to configure the date-format used by the default logger.
- Added: Arbitrary ****-data/remote info can now be returned by connectors (for display/troubleshooting/statistics).
- Added: Multiple client ids (oscam, scam, rq-sssp etc).
- Added: More example plugins included.

- Changes to proxy.xml:
  Added: Element <csp-connect> to <status-web> (to receive csp-connections, enabled by default).
  Added: Element <csp-connector> to <connectors> (to define csp-connectors). See proxy-reference.html.
  Added: Element <chameleon-connector> to <connectors> (connector to a newcs/chameleon setup as mgcamd). Same as a
  newcamd-connector, except it is not bound to a profile, always asynchronous and ignoring the client-id setting.
  Added: Element <extended-newcamd> to <profiles> (unbound port for extended newcamd protocol, as used between mgcamd
  and newcs). Allows mgcamd to use multiple systems (all profiles the user has access to) over a single connection.
  Added: Element <log-dateformat> to <logging> (optional java SimpleDateFormat string to use for the standard logs).
  Added: Attribute 'provider-idents' to <profile> (optional, allows listing of provider-idents, even with no connectors).
  Added: Attribute 'require-provider-match' to <profile> (true/false, default: true). Set to false if you know that for
  this profile, provider idents in ecm requests do not need to match those on the cards (this is the case for irdeto).
  NOTE: If require-provider-match is false, provider-idents will get 000000 added automatically. Conversely, if only
  ident 000000 is specified for a profile, require-provider-match defaults to false instead of true when omitted.
  Added: Attribute 'provider-idents' to <newcamd-connector>, (optional, overrides the idents from the server/card).
  Added: Attribute 'exclusive' to <can-decode-services> (true/false, default: false). Set to true for a list to indicate
  that there should be no probing done for the connector, only those services listed are to be considered decodable.
  Added: Attribute 'profile' to <can-decode-services> and <cannot-decode-services>. Only applicable for connector types
  csp-connector and chameleon-connector, where multiple lists can be used to specify services for several profiles.
  that there should be no probing done for the connector, only those services listed are to be considered decodable.
  Changed: Attribute 'provider' for <service-file> changed to 'filter' to avoid confusion. If provider-idents have been
  specified correctly for the profile, there is no longer any need to repeat that list in the case of cccam parsing.
  Changed: All elements that allowed hex sid lists to be specified (per connector or profile) now accept an alternate
  syntax sid:cid (where cid is custom id, used for situations like the irdeto chid where sid alone is not enough).
  NOTE: <allow-services> is an exception, checks against that list are made with sid only.
  Added: Element <redundant-forwarding> to <mapper> (true/false, default: false). Can be set globally or per profile,
  as with other mapping settings. Transactions that trigger redundant forwarding will get the new flag '2'.

- Changes to the http/xml api: (always use /xmlHandler?command=status-commands or ctrl-commands to see syntax).
  Added: New status command 'export-services', dumps the internal state of the service maps (admin only). Add the param
  format=hex for an alternate format matching the sid lists used in the config.
  Added: New status command 'system-properties', shows the JVM system properties (superuser only).
  Added: New status command 'system-threads', dumps all JVM threads as strings (superuser only).
  Added: New status command 'login-failures', shows a list of failed login attempts per user or ip (for most interfaces).
  Added: New status command 'proxy-plugins' for listing all loaded plugins and any associated info they publish.
  Added: New ctrl command 'gen-keystore', auto creates a java keystore for using the status web with SSL.
  Added: New ctrl command 'disable-connector', temporarily disables a specified connector.
  Added: New ctrl command 'set-profile-debug', temporarily changes debug flags (set to false for ALL to delete ecm logs).
  Added: New ctrl command 'remove-failed', removes entries matching specified wildcard mask from login-failures.
  Added: Attribute 'time' to <jvm> (proxy-status output). Local system time as a rfc822 date.
  Added: Attribute 'cdata' to <service> (most output containing services). Custom data for service mapping (chid/ident).
  Added: Element <remote-info> to <connector> (cws-connectors output). List of <cws-param> elements with name/value
  attributes, containing arbitrary information about the connector.
  Added: Attributes 'network-id', 'ca-id', 'provider-ident' and 'origin-id' to <ecm> (transaction logs). These are only
  included when the transaction occured in the '*' profile, and origin-id only for CspSession transactions.
 

elgeneral

Registered
Messages
7,811
cardservproxy-0.9.0.RC6(5)

12-07-2010


(see README.0.9.0.txt for conceptual changes and tips)

Gracias a DrPepper
 

elgeneral

Registered
Messages
7,811
CSP Version 0.9.0 RC6 (SB SVN r11)

28-07-2010

Changes to r7
:

Author: bowman

Added a generic profile ****-data set to the csp-connect protocol, to enable showing more details about remote profile configs (to see if they make sense). Currently only includes the effective max-cw-wait and max-cache-wait values for each mapped profile in a csp-connector.

Made it possible to specify max-cache-wait as a percentage of max-cw-wait (makes more sense when using multiple profiles with different max-cw-wait limits).


Synced minor logging changes from old local repos.

Added clear-history command to DreamboxPlugin?
 

elgeneral

Registered
Messages
7,811
CSP Version 0.9.0 RC6 (SB SVN r14)

Changes to r11
:

Author: merek

Some more caid's for exotic ca systems in ca.properties


Author: bowman

Updated config reference.


Author: bowman

Added build number + a hack to use the current svn repository revision as build number for cardservproxy.jar, when the ant build is able to execute svnversion (needs to be in PATH)
 

elgeneral

Registered
Messages
7,811
CSP Version 0.9.0 RC6 (SB SVN r15)

Changes to r11:

Author: merek

Show SVN build also in DreamboxPlugin


Author: merek

Some more caid's for exotic ca systems in ca.properties


Author: bowman

Updated config reference.


Author: bowman

Added build number + a hack to use the current svn repository revision as build number for cardservproxy.jar, when the ant build is
 

elgeneral

Registered
Messages
7,811
CSP Version 0.9.0 RC6 (SB SVN r18)

Changes to r14
:

Author: bowman

Fixed potentially serious ClusteredCache? bug (affecting all installations where sync-period > 0).


Author: bowman

Made the file log web tracking configurable (via warning-threshold) and updated logging + docs for consistency.


Author: bowman

Added a status command and web view showing the latest 40 filelog events with level WARNING or SEVERE (admin users only).
 

Minicat

Registered
Messages
1,764
CSP Version 0.9.0 RC6 (SB SVN r22)

Changes


18:59 Changeset [22] by bowman
Forgot to change the error msg.
18:08 Changeset [21] by bowman
Fixed jvm check and added startup hint.
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.0 RC6 (SB SVN r27)

Changes to r20:
Author: merek

- Dont use -Xmx512m as default in init scripts, as this could break small installations
- Add LSB information to ubuntu/debian init scripts

Author: DrPepper

Changed Memory Allocation to 512MB

Author: DrPepper

Changed Memory Allocation to 512MB

Author: bowman

Added ecm source to logging for service discovery (easier to se who caused an addition to service maps).

Author: bowman

Prepared for 0.9.0 release.

Author: bowman

Forgot to change the error msg.

Author: bowman

Fixed jvm check and added startup hint
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.0 Release (SB SVN r33)

Changeset [33] by bowman
Revert inclusion of multi-context connectors in profile-specific …

Changeset [32] by bowman
Fixed issues reported for 0.9.0 (see changelog.txt)

Changeset [31] by bowman
Distribution date
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.0 Release (SB SVN r35)

Changeset [35] by bowman
Per profile max-cw-wait value can now be set below <1s, like the global …
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.1 RC0 (SB SVN r42)

Changeset [42] by bowman

- More fixes to cache extension framework.
 

juli13

Staff member
Administrator
Messages
10,194
06/10/2010

Code:
[B]0.9.1 - RC0-svn-r44[/B]

- Fixed: Handling for unknown sid (0 or a dummy sid listed in dummy-services) was broken in 0.9.0.
- Fixed: Incoming requests for dummy sids should not retain the dummy when forwarded, now changed to 0.
- Fixed: Per profile max-cw-wait could not be set below 1s (now both per profile and global allow down to 100 ms).
- Fixed: Probing was sometimes attempted even when there was only one candidate connector.
- Fixed: Radegast support updated to make sense with 0.9.x.
- Changed: Two ecms (or dcw replies) with the same payload data but different dvb table ids (even/0x80 vs odd/0x81) are
now considered identical by the proxy. Implications unknown.
- Changed: ClusteredCache transport format now includes ****-data such as ca-id and network-id.
NOTE: This breaks compatibility with previous versions. If one node has the new format, all nodes must be upgraded.
- Added: Cws event for found service now shown in the status-web (despite the command being called error-log).
- Added: Experimental sid cache linking feature, allows cache hits based on ****-data like sid rather than ecm payload.
Links added via the web commands are stored in etc/links.cfg (this file is monitored for changes and autoloaded also).
- Added: More sanity checks to DcwFilterPlugin (checksums, length and an option to monitor all replies for duplicates).

- Changes to proxy.xml:
Added: Attribute 'enable-service-linking' to <cache-handler> (true/false, default: false). Enables sid cache linker.

- Changes to the http/xml api:
Added: Attribute 'filtered-by' to <ecm> (transaction logs). Contains the reason for a B flag, or the filtering plugin.
Added: New event type 9 - "found service" added to connector events output (error-log, yes - not really an error).
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.1 RC0 (SB SVN r46)

Changeset [46] by bowman
Updated docs and more cleanup for 0.9.1.

Changeset [45] by bowman
Updated DreamboxPlugin? agent and ssh solution to work for more (older) 500 …
 

juli13

Staff member
Administrator
Messages
10,194
15/10/2010

Code:
Changeset [48] by bowman 
Added enigma_zap example script to DreamboxPlugin?.

Changeset [47] by bowman 
Experiments to (maybe) make the web work better under high load/high error scenarios.
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.1 RC0 (SB SVN r52)

Changeset[52] by merek
Adding BetacryptTunnelPlugin? - CSP Version of OSCam Betatunnel feature.

Changeset [51] by bowman
Fix to allow plugins to move messages between profiles.

Changeset [50] by bowman
Preparations for 0.9.1 RC, misc fixes and cleanup.

Changeset [49] by bowman
Added (untested) foundations for more advanced dcw verification in …
 

juli13

Staff member
Administrator
Messages
10,194
27/10/2010
Code:
Csp 0.9.0 r57 Betatunnel plugin from oscam betatunnel
 

juli13

Staff member
Administrator
Messages
10,194
16/11/2010

Csp 0.9.0 r59
Code:
[B]lastest changes:[/B]

-Added subscription info as well as SA/UA to status web (only 
-Added support for multiple CAID's. Added 093E to the existing 090F.
 

tani1

Staff member
Super Moderator
Messages
17,767
CSP Version 0.9.1 RC0 (SB SVN r65)

Changeset [65] by doncarlo
Add MySQLUserManager and MySQLWebManagementPlugin. All necessary …

Changeset [64] by merek
Update Maxmind GeoIP API in GeoIP Plugin

Changeset [63] by merek
revert last commit (my fault)

Changeset [62] by merek
Fix some UTF8 warnings in GeoipPlugin?

Changeset [61] by merek
Add iCVS and GP3 Plugin Support to CSP Agent (0.9.9)
 
Status
Not open for further replies.
Top